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FOREWORD 


This  report  documents  a  study  directed  toward  summarizing  and 
evaluating  new  modeling  approaches  useful  in  human-pilot/vehicle 
analysis.  It  has  been  accomplished  under  Contract  AF  33(^1 5) -5^52 , 
BPSN: ,6(63821 9-62^05364),  sponsored  by  the  Flight  Control  Division 
of  the  Air  Force  Flight  Dynamics  Laboratory  under  Project  8219, 
"Stability  and  Control  Investigations,"  Task  821904,  "Flight  Control 
Systems  Analysis."  The  research  has  been  performed  by  Systems 
Technology,  Inc.,  at  both  its  Hawthorne,  Calif.,  and  Princeton,  N.  J., 
offices.  Work  conducted  under  this. program  was  performed  between 
March  1966  and  June  1967*  The  manuscript  was  initially  released 
by  the  authors  July  19^7  for  publication  as  an  AFFDL  technical  report. 
The  principal  investigator  has  been  Mr.  D.  T.  McRuer,  and  the  Flight 
Control  Division  project  monitor  has  been  Mr.  F.  L.  George. 

A  number  of  STI  staff  members  have  participated  in  the  study, 
because  of  the  diversity  of  the  included  topics.  Major  contributors 
are  listed  as  authors.  Important  contributions  to  several  of  the 
analytical  activities  have  also  been  made  by  Mr.  E.  Magdaleno  and 
Mr.  G.  L.  Teper  of  STI.  Gratitude  is  extended  to  Mr.  F.  L.  George, 

Mr.  R.  0.  Anderson,  and  Mr.  P.  E*  Pietrzak  of  the  Flight  Control 
Division  for  their  review  and  comments.  Finally,  the  authors  are 
indebted  to  the  STI  production  staff  for  their  careful  work  in 
preparing  the  manuscript. 

This  technical  report  has  been  reviewed  and  is  approved. 


CHARLES  B.  WESTBROOK  ' 

Chief,  Control  Criteria  Branch 

Flight  Control  Division 

Air  Force  Flight  Dynamics  Laboratory 
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ABSTRACT 


New  models  for  human  pilot  dynamics  and  new  methods  for  pilot /vehicle 
dynamic  analysis  are  investigated.  The  status  of  existing  quasi-linear 
models  is  reviewed  and  deficiencies  are  noted  as  a  basis  for  pinpointing 
areas  needing  the  most  effort.  The  pilot  modeling  topics  explored  include 
low  frequency  lead  generation  using  either  velocity  sensing  at  the  peri¬ 
phery  (eye)  or  difference  computations  accomplished  at  a  more  central 
level;  mode -switching  models  for  nonstationary  or  discrete  inputs  to  the 
pilot/ vehicle  system;  physiological  aspects  of  pilot  dynamics  in  tracking 
tasks;  Successive  Organization  of  Perception  (SOP)  theory  for  levels  of 
pilot  cognition  higher  than  compensatory.  For  pilot/vehicle  analysis, 
analytical  approaches  from  control  theory  which  appear  to  have  promise 
are  studied,  including:  time-optimal  computing  feedforward  elements  use¬ 
ful  in  the  mode -switching  models  for  response  to  nonstationary  inputs; 
optimal  control  theory  using  the  crossover  model  in  the  performance \ 
criterion  to  estimate  pilot  response  characteristics  in  compensatory^ 
tasks;  inverse  optimal  control  theory  using  known  experimental  results 
and  quasi-linear  pilot  response  models  in  an  effort  to  define  the  pilot's 
adjustment  rules  in  terms  of  performance  indices;  optimal  control  theory 
to  provide  a  simple  test  for  optimality  (to  an  elementary  quadratic 
criterion)  using  only  average  performance  measure  data. 

Distribution  of  this  Abstract  is  Unlimited. 
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Control  surface  deflection  (aileron) 

Frequency  weighted  error  in  frequency  domain  formulation 
Difference  between  desired  output  and  actual  output 
Eyeball  position  error 

i 

Damping  ratio 

Closed-loop  damping  ratio 

Damping  ratio  of  Dutch  roll  second  order 

Neuromuscular  system  damping  ratio 

Vehicle  pitch  attitude 

Attitude  control  input 

Weighting  parameter  for  pilot  control  effort 
Eyeball  position  (see  Fig.  10) 

Real  part  of  complex  variable,  s  =  a  ±  Jen 
rms  value  of  pilot  output 
rms  value  of  error  velocity 
Pure  time  delay 

Pure  time  delay  decrement  due  to  forcing  function 
Effective  pure  time  delay 

Effective  pure  time  delay  for  zero  forcing  function 
bandwidth 

Alpha  motor  neuron  time  delay 
Ganaa  motor  neuron  time  delay 
Vehicle  roll  or  bank  angle 
Final  roll  angle 
System  phase  margin 
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Forcing  function  spectrum 
Pilot  remnant  spectrum 

This  is  special  case  of  $nni  for  compensatory  display 

Pilot  remnant  spectrum  when  considered  as  a  quantity 
.injected  at  the  system  input 

Angular  frequency  (rad/sec) 

Crossover  frequency,  i.e.,  frequency  at  which  |YpYc|  =  1 

Basic  crossover  frequency  for  very  low  bandwidth  inputs 

Undamped  natural  frequency  of  the  Dutch  roll  second  order 

Forcing  function  bandwidth 

Limb/manipulator  undamped  natural  frequency 

Undamped  natural  frequency 

Neuromuscular  system  natural  frequency 

Rate  of  object  motion 

Equivalent  velocity  of  object 

Prime  denotes  closed-loop  time  constant ,  or  transpose  of 
a  vector  or  matrix 

Summation 

Complix  conjugate 

Sum  of  terms  in  partial  fraction  expansion  of  enclosed 
quantity  having  left-half-plane  roots 

Derivative  with  respect  to  time  of  quantity 

Denotes  averaged  values 

The  ratio  of  the  product  of  the  left  half  plane  zeros  of  (  ) 
to  the  product  of  the  left  half  plane  poles 

The  ratio  of  the  product  of  the  left  half  plane  zeros  of  (  ) 
to  the  produet  of  the  right  half  plane  poles 
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A.  BACKGROUND 

The  current  status  of  quasi -linear  models  for  the  description  of 
human  pilot  dynamics  is  good  enough  to  provide  useful  and  effective  tools 
for  the  solution  of  a  variety  of  practical  flight  control  problems. 
Nevertheless,  a  number  of  important  and  troublesome  problems  cannot  be 
handled  within  the  quasi-linear  context  and,  as  a  consequence,  a  practical 
requirement  exists  for  new  approaches.  Fortunately,  there  are  a  large 
number  of  methods  available  from  automatic  control  theory  which  offer 
some  promise  as  methods  to  be  applied  to  manual  control,  and  there  are 
new  views  of  old  data  which  may  also  prove  fruitful.  From  these  well- 
springs  it  is  hoped  to  evolve  the  new  approaches  needed.  The  purpose  of 
this  program  is  to  match  some  of  the  methods  to  some  of  the  problems,  and 
to  summarize  and  evaluate  these  new  approaches  to  pilot/vehicle  analysis. 

i.  census  or  dbsdobd  xnrHooe  m  uam a 

The  methods  and  models  sought  through  the  new  approaches  should  have 
potential  application  to  flight  control  tasks  and  control  system  design 
problems.  A  further  qualification  is  that  they  be  appropriate  for  use  in 
some  aspect  of  system  prediction ;  for  example,  to  predict 

«  System  performance  in  a  given  situation 

•  Pilot  activity  in  a  given  situation 

•  Pilot  commentary  aDd  opinion  rating  trends  acrosB  situations 

The  types  of  control  situations  for  which  the  capability  to  predict  becomes 
a  requirement  might  include 

•  Closed-loop  control  and  regulation  of  attitude  or  path  about 

a  fixed  operating  point  or  about  time -variable  operating  points 

•  Open-loop  response  to  external  or  Internal  commands  and 
disturbances 

•  Control  retention  during  abrupt  changes  in  the  controlled 
element,  as  during  a  stability  augroenter  failure 
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Ideally,  the  models  should  be  able  to  describe  behavioral  differences 
In  control  situations  which  are  due  to  changes  In  the  Informational  Input 
(or  display)  conditions.  For  the  exemplary  control  situations  noted 
above,  this  might  be  due  to  differences  such  as 

e  Complete  VFR  display  plus  all  motion  cues 

e  The  more  restrictive  IFR  display  plus  all  motion  cues 

e  Incomplete  variants  of  the  above,  corresponding  to  various 
ground -simulator  conditions 

0.  APPROACH 

The  inspiration  and  requirements  for  new  methods  or  models  can  derive 
from  two  sources:  (1)  knowledge  of  analytical  approaches  which  may  con¬ 
ceivably  be  applied  (solutions  in  search  of  problems) ;  (2)  deficiencies 
in  existing  models  (problems  in  search  of  solutions).  The  basic  approach 
adopted  in  this  report  is  to  use  the  status  and  deficiencies  of  extant 
quasl-llnear  models  to  structure  a  frame  of  reference  for  the  pursuit  of 
new  methods  and  models.  This  does  not  Imply  a  universality  of  application 
for  quasi -linear  techniques,  but  takes  advantage  of  the  accumulated  knowl¬ 
edge  of  their  shortcomings,  and  the  realization  that  alternative  approaches 
must  be  developed  if  a  number  of  critical  flight  control  problems  are  to 
be  attacked  at  all.  The  new  approaches,  derive,  inductively,  from  consid¬ 
eration  of  what  is  deficient  in  the  current  state-of-the-art,  followed  by 
attempts  to  solve  the  particular  problems  exposed  with  whatever  techniques 
are  available;  and,  deductively,  starting  with  a  method  or  theory  and 
looking  for  problems  it  can  solve.  Both  kinds  of  initial  points  are 
represented  here. 

D.  PREVIEW  07  THE  REPORT 

The  report  really  consists  of  two  parts.  The  first  comprises 
Sections  II  and  III  which  summarize  the  status  quo  as  evidenced  by  the 
qua si -linear  pilot  models.  The  remaining  sections  present  the  various 
new  models/methods,  each  in  a  separate  section  for  clarity. 

Section  II  summarizes  the  current  status  of  quasi-linear  models  for 
compensatory  and  pursuit  tracking,  multiloop  tasks,  and  the  neuromuscular 
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subsystem.  This  provides  the  prologue  to  Section  III!  where  s  001141  re  he  ns  ive 
tabulation  of  the  deficiencies  of  these  modal*  la  given,  thereby  defining 
the  problem  areas. 

The  first  new  model/method  topic  (Section  IV)  is  a  preliminary  exami¬ 
nation  of  low  frequency  lead  generation.  Two  possible  and  complementary 
schemes  are  proposed.  In  one  the  lead  derives  from  velocity  computation  at 
the  optic  nerve  level,  whereas  the  other  depends  on  computation  of  first- 
position  differences  at  a  more  central  location.  Each  modol  accounts  for 
some  of  the  observed  differences  in  behavior  between  situations  requiring 
low  frequency  lead  and  those  which  do  not.  Doth  models  are  refinements  in 
detail  to  existing  quaai-linear  description?]. 

Section  V  examines  the  most  elementary  nonstationary  situation,  where 
the  nonstationary  feature  is  a  transient,  l.e.,  step  forcing  function. 

The  most  complete  model  available  at  the  outset  of  this  program  la  first 
reviewed  and  used  as  a  basis  for  constructing  an  experimental  program.  The 
experimental  data  are  then  presented.  In  the  event  theBe  contradict  many 
of  the  features  of  the  hypothetical  model,  s  new  dual-mode  control  model  is 
presented  aa  a  replacement. 

In  Section  VI  the  Successive  Organization  of  Perception  (SOP)  hypothesis 
1b  reviewed  and  elaborated.  The  major  purpose  of  this  section  is  to  present 
an  efficient  way  of  coding  and  selecting  the  moBt  likely  mode  of  behavior 
from  those  which  have  been  identified  and  modeled  aB  phases  within  the 
over-all  Successive  Organization  of  Perception  context.  Jt  is,  among  other 
things,  a  description  of  an  analysis  procedure  which  enables  one  to  select 
model  forms  appropriate  to  a  specific  situation. 

Physiological  aspects  of  human  tracking  behavior  are  described  in 
Section  VII.  Signal  flow  and  functional  operations  compatible  with  physio¬ 
logical  knowledge  are  shown,  and  various  substructures  capable  of  exhibiting 
the  "special  case"  behavioral  pattern*  associated  with  compensatory,  pursuit, 
and  precognitive  operations  are  discussed. 

The  last  three  sections  are  attempts  to  apply  the  powerful  techniques 
of  optlnal  control  theory  to  alleviate  Borne  of  the  deficiencies  in  quasi- 
linear  models  summarized  in  Section  III.  The  first  question  attacked  (in 
Section  VIII)  is  the  optimality  of  manual  control  systems  for  elementary 
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performance  criteria  auch  as  mean-squared  error.  This  is  accomplished 
using  a  simple  test  for  optimality  which  involves  only  the  mean- squared 
value  of  signals  within  the  manual  control  system  and  requires  no  knowl¬ 
edge  of  che  dynamic  details.  The  experimental  results  are  introduced  to 
comparo  with  the  theoretical  constructions. 

In  Section  IX  the  Inverse  optimal  control  problem  1r  used  in  an  effort 
to  formulate  compensatory  tracking  performance  indices  for  which  the  loop 
dynamics,  YpYc,  measured  experimentally  are  optimal,  luis  approach  can 
provide  a  more  quantitative  bawls  for  adjustment. 

Finally,  Section  X  considers  the  estimation  of  human  pilot  describing 
functions  for  novel  situations  by  using  optimal  control  theory.  The 
procedures  described  permit  much  of  the  artistry  in  estimating  describing 
functions  for  given  controlled  elements  to  be  replaced  by  a  concrete 
computational  procedure. 
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Quaei-linear  models  are  the  meet  extensively  applied  and  best  based 
empirically  of  all  models  for  pilot  behavior.  They  are  totally  satis¬ 
factory  for  many  problems,  while  for  others  they  either  have  some 
promise  contingent  on  further  development  or  are  fundamentally  deficient* 

To  correct  theBe  latter  shortcomings  new  model/method  structures  are 
needed,  and  one  starting  point  for  defining  these  new  approaches  is 
provided  by  the  existing  structure  of  quasi -linear  pilot  models. 

The  status  of  quasi-llnear  models  is  summarized  in  this  section  to 
provide  this  frame  of  reference.  Single-loop  compensatory  situations 
are  mentioned  first,  followed  by  the  single-loop  pursuit  models.  Then, 
a  digression  is  made  to  consider  the  characteristics  of  the  neuromuscular 
subsystem,  a  key  element  in  any  model  of  the  pilot.  Next,  the  struc¬ 
ture  of  multiloop  control  is  summarized.  Finally,  the  more  significant 
restrictions  to  be  considered  in  the  application  of  extant  quasi-linear 
models  are  noted. 

A.  Small!*’ LOOP  COMPENSATORY 

The  first  problem  in  manual  control  system  dynamics  is  to  determine 
the  pilot  response  in  the  single-axis  compensatory  tracking  task  defined  by 
the  block  diagram  of  Fig.  1  .  A  stationary  random-appearing  forcing  func¬ 
tion,  i(t) ,  Is  applied  which  results  in  a  displayed  error,  e(t).  The  pilot 
output,  c(t),  acts  on  the  fixed  controlled  element  dynamics,  Yc,  to  produce 
the  system  output,  m(t). 


Pilot 


Figure  1  .  Single -Axis  Compensatory  Tracking 


Controlled 

Element 
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Measurements  of  pilot  characteristics  in  this  task  have  been  made 
by  a  large  number  of  investigators  over  the  last  twenty  years  (Refs.  1-15)* 
A  summary  of  results  based  on  cross-spectral  and  spectral  analysis  is 
given  In  Table  I. 

At  various  times*  throughout  the  period  during  which  this  now  loosing 
data  base  was  being  accumulated,  Analytical/Verbal  Models  were  evolved 
which  described  or  were  compatible  with  all  the  then  existing  data. 

Besides  serving  as  encapsulated  descriptions  of  the  data,  these  models 
were  also  intended  to  be  used  in  new  situations  which  are  extrapolations 
of  those  for  which  the  data  were  obtained.  In  fact,  the  primary  emphasis 
in  the  entire  model -building  effort  has  been  placed  on  models  which  can 
be  used  to  predict  pilot  dynamic  response  characteristics  in  manual 
vehicular  control  systems. 

Another  cut  has  been  taken  recently  at  updating  the  Analytical/Verbal 
Quasi -linear  Pilot  Model.  This  was  accomplished  mainly  in  connection  with 
Ref.  12,  although  it  is  not  explicitly  contained  therein,  and  is  summarized 
in  Ref.  17  as  the  circa  1965  model.  As  with  the  other  models  mentioned 
above,  the  circa  1965  model  consists  of  two  parts — the  describing  function 
and  the  remnant  —  and  contains  two  kinds  of  information:  (1)  analytical, 
giving  the  general  form  of  the  dynamics,  and  (2)  verbal,  providing  the 
adjustment  rules  which  tell  how  the  parameters  in  the  general  form  are  to 
be  adjusted  so  that  the  model  is  an  estimate  of  pilot  behavior  for  a 
specified  situation.  The  describing  function  portion  of  the  circa  1965 
Analytical/Verbal  Model  is  summarized  below.  It  is  generally  applicable 
to  fixed-base  tracking  or  regulation  problems  where  the  system  Inputs  are 
random-appearing,  and  where  the  pilot,  vehicle,  and  inputs  are  reasonably 
time -stationary . 


*For  example:  1957,  Ref.  6;  1959 >  Ref.  l6j  I960*  Ref.  11. 
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ho.  or 

CONTROLLED 

ELEMENT 

TYPES 

INVESTIGATED 

- 1 

MANIPULATOR 

NO.  or 
CROSSOVER 
REGION 
MEASUREMENTS 

REMARKS 

Spade  grip, 
spring  reetmlnt 


Handwheel, 
no  restraint 


Aircraft 
control  stick 


Aircraft 
control  stick 


Pencil-like 
stylus,  no 
restraint 


All'- raft 
control  stick 


Aircraft 
con -rol  wheel 


lateral 
side  stick 


lateral 
side  stick 
and 

rudder  pedals 


Longitudinal 
side  stick, 
spring  ani  inertia 
restraint 


Aircraft 
control  stick 


Simulated  tank  gun  turret 
tracking.  Single-dimensional 
input. 


Single-dimensional  input. 


Simulated  control  of  aircraft 
pitch  axis  in  both  stationary 
and  pitching  simulator. 
Single-dimensional  input. 


Simulated  control  of  aircraft 
lateral  and  longitudiiml  axes 
in  tail-chase,  with  and  with¬ 
out  airframe  dynamics.  Two- 
dimensional  Input. 


Single-dimensional  input.  Sene 
remnant,  data. 


Stabilization  of  aircraft 
lateral  and  longitudinal  axes 
in  both  flight  and  fixed-base 
simulator.  Two-dimensional 
input . 


Stabilization  of  various  air¬ 
craft  longitudinal  dynamics 
while  also  controlling  a  fixed 
set  of  lateral  characteristics. 
Two-dimensional  Input. 


Stabilization  of  a  wide  range 
of  Idealized  dynamics  contrived 
to  evoke  a  complete  range  of 
operator  transfer  characteris¬ 
tics.  Single-dimensional 
input.  Good  remnant  data. 


True  multiloop  situation, 
lateral  control  in  a  tail- 
chase.  Single-dimensional 
input,  two-dimensional  display. 


Extreme  ranges  of  restraint  and 
controlled  element  values. 
Single-dimensional  input. 


Stabilization  of  aircraft 
lateral  and  longitudinal  axes 
in  both  flight  and  fixed-base 
simulator.  8ingle-dlmensional 
input. 


1 .  The  Ciroa  1 9$5  Analytioal/V* rtal  Describing  Function  Modal 


a.  Qanexml  describing  function  form.  For  visual  Inputs  in  single-loop 
systems  the  general  describing  function  form  for  the  human  pilot  is  that  of 
the  precision  model: 


For  conditionally  stable  loops  the  low  frequency  phase  can  be  an  important 
feature  of  the  manual  control  system  and  an  appropriate  simplified  version 
of  Eq.  1  is 

..  •  /TLJ“+  -ih.  +  T»)  +  a/a>l  (2) 
YP  KP^IJa>+  T/  e 

This  form  is  also  adequate  for  most  other  systems  as  well.  However,  for 
loops  wherein  low  frequency  performance  is  essentially  unaffected  by  the 
low  frequency  phase  lag  term,  e~Ja/a>,  Eq.  1  can  be  simplified  to 


TlJ<o+  1 
TjJco  +  1 


) 


e-JO)(T  +  Tjj) 


(3) 


In  either  of  Eqs.  2  and  3  the  e  i6  interchangeable  with  (TnJ<jd  +  1)  1 

Furthermore,  if  aJT  <  1 ,  e-”*^  =  -[(t/2)s  —  l]/[(T/2)s  +1  ]  . 

b .  Adjustment  rules 

(1)  Squall ration  salaotlon  aad  adjustment.  A  particular  equaliza¬ 
tion  is  selected  from  the  general  form  Kp(TlJo)  + 1  )/(TiJ<w  + 1 )  such  that 
the  following  properties  obtain: 

(a)  The  system  can  be  stabilized  by  proper  selection  of 
gain,  preferably  over  a  very  broad  region. 

(b)  Over  a  considerable  frequency  range  in  the  crossover 
region  (that  frequency  band  centered  on  the  crossover  frequency, 

(%) ,  |YpYc!db  ilaB  approximately  a  -20  db/decade  slope. 

(o)  lYp  Yc|  »1  at  low  frequencies  to  provide  good  low  fre¬ 
quency  closed-loop  response  to  system  forcing  functions  (commands). 

Examples  of  form  selection  and  basic  adjustment  are  provided  in 
Table  II. 
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(2)  Effective  ti M  delay.  After  the  appropriate  equalization 
form  has  been  adopted,  the  net  effect  in  the  region  of  crossover 
of  high  frequency  (relative  to  crossover)  leads  and  lags  can  be 
approximated  by  replacing  these  terms  in  Eqs.  1,  2,  or  3  with  a 
pure  time  delay  term,  e-J^e.  The  effective  time  delay,  Te,  is 
the  sum  of  all  the  human  pilot's  pure  time  delays  and  high  fre¬ 
quency  lags  less  the  high  frequency  leads;  i.e., 

te  =  t  +  TNi  +  ~  TI*ii  (for  1 )  (*0 

=  t  +  Tn  -  Ti^  (for  Eqs.  2,  3)  (5) 

The  notation  Ti^  implies  that  only  those  Tl's  used  to  partially 
compensate  for  high  frequency  phase  lags  (e.g.,  see  Table  XI)  are 
involved;  otherwise  Ti^  =0.  In  general  Te  depends  on  both  the 
controlled  element  dynamics  and  the  forcing  function  bandwidth. 

These  dependencies  are  approximately  serial;  viz, 

Te(Yc  >  a*)  ■  ToC*c)  "  ATe(a>i)  where  ATe(0)  =  0  (6) 

(a)  Estimation  of  T0.  t0  can  be  estimated  from  the 
effective  order  of  Yc  in  the  crossover  region  using  the 
data  of  Table  III. 


TABIE  III 
EFFECT  OF  Yc  ON  t0 


Effective 

Y r  in 
Crossover 
Region 

illcldb 

a)  *  a\. 

:ade) 

To 

(sec) 

d  In  co 

( db/dec 

Kc 

0 

0.53 

Kc/J® 

—20 

0.36 

Kc/(J0))2 

-4o 

0.52 

(19)  Incremental  t®  due  to  forcing  function.  The  portion 
of  Te  given  by  tq  is  all  there  is  to  Te  when  the  forcing  func¬ 
tion  bandwidth,  ay.,  is  zero  or  very  small.  As»oy  is  increased, 
however,  the  neuromuscular  lag,  Tr,  and/or  the  equalizer  lead, 
TLhi,  are  adjusted  to  reduce  the  net  lag  described  by  t®.  A 
fir6t-order  approximation  for  this  effect,  good  for  all  con¬ 
trolled  elements,  is 

Atc  i  0.08ay.  (7) 

where  At®  is  in  seconds  and  ay  is  in  radlans/second 
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(3)  Crossover  frequency,  <% 

(a)  Baslo  crossover  frequency,  at0-  The  basic  cross¬ 
over  frequency  for  tasks  where  ay.  is  zero  or  very  small, 
denoted  as  o*;0,  is  found  by  adding  the  phase  angle,  -ayr0, 
due  to  the  high  frequency  phase  lag,  to  that  of  the  con¬ 
trolled  element  and  the  previously  estimated  Yp  equalizer 
characteristics.  Estimates  for  the  basic  crossover  fre¬ 
quency,  cuc0,  and  the  gain  are  then  made  from  the  conditions 
for  neutral  stability. 

(%)  ofe  invariance  properties 

t)  ofe — Xe  independence.  After  initial  adjust¬ 
ment,  changes  in  controlled  element  gain.  Kg,  are  offset  by 
changes  in  pilot  gain,  Kp;  i.e.,  system  crossover  frequency, 
cq,,  is  invariant  with 

2)  — ay  independence.  System  crossover  fre¬ 
quency  depends  only  slightly  on  forcing  function  bandwidth 
with  ay<0.8cq.o. 

3)  Ok  regression.  When  ay.  nears  or  becomes 
greater  than  0.8ateo,  the  crossover  frequency  regresses  to 
values  much  lower  than  ofcQ. 

4)  Phase  margin  adjustment  with  a*.  Since  a*,  is 
essentially  independent  of  ay.,  and  ATe  is  directly  propor¬ 
tional  to  ay.,  the  system  phase  margin,  is  directly  pro¬ 
portional  to  ay.  This  strong  dependence  of  phase  margin  on 
the  forcing  function  bandwidth  is  associated  with  the  linear 
variation  of  ATe  with  ay,  and  is  essentially  an  alternate 
statement  of  Eq.  7. 

B.  BUOZJ-LOO?  PUMUXT 

Pursuit  behavior  Is  formally  distinguished  from  compensatory  by  the 
addition  of  the  feedforward  loop  containing  the  block  Yp^  aad/or  the 
direct  feedback  of  output  via  the  block  Ypg  to  describe  the  pilot's 
actions.  These  are  shown  in  Fig.  2.  The  Yp^  operation  indicates  that 
the  pilot  has  full  knowledge  of  the  forcing  function  either  directly 
or  by  implication  and  takes  advantage  of  this  knowledge  to  appropriately 
modify  his  response.  The  Ypg  operation  represents  a  similar  kind  of 
action  on  the  output.  Those  functions  which  are  typically  Internal  to 
the  pilot  are  enclosed  by  a  dashed  line  in  Fig.  2,  including  the 
differential  which  produces  some  error,  e.  In  the  alternative  case 
where  e  and  m  are  available,  1  may  be  inferred  by  the  pilot. 
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Figure  2.  Single-Axis  Pursuit  Tracking 


Recent  experimental  activities  (Ref.  18)  have  resulted  in  a  better 
understanding  of  pursuit  behavior.  One  explanation  of  these  results  is 
that  the  block  operating  on  the  error,  YPe>  is  much  the  same  as  the  quasi - 
linear  describing  function  for  compensatory  tracking,  and  that  the  pilot 
does  vise  his  additional  knowledge  of  the  forcing  function  to  improve  his 
performance  with  YP1-  Operations  in  which  YPjn  are  likely  to  be  generated 
have  not  yet  been  demonstrated. 


The  adjustment  of  Yp^  is  nearly  { Yp^Yc I  *  1  over  a  fairly  broad 
frequency  range.  The  phase  angle  of  YPiYc  varies  from  zero  somewhat,  but 
otherwise  the  action  of  the  feedforward  is  such  as  to  reduce  the  error  to 
zero,  and  to  make  the  output  follow  the  input  closely.  That  the  "proper" 
action  by  the  pilot  is  to  approximately  invert  the  controlled  element  is 
apparent  from  the  relationships  between  output,  error,  and  forcing  func¬ 
tion,  i.e., 


M(jto) 


(YPl  +  YPe)Yc*(J“>)  +  Yc»c(J<*>) 
1  *YPeYc 


(8) 


E(j<n) 


(1  -YPiYc)I<Ja>)  “  Yc»c(Ja>) 

1  YPeYc 


(9) 


If  the  remnant  is  neglected,  the  output,  M(ju>),  will  equal  the  input  and 
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the  error  will  be  zero  when  Yp^  =  l/Yc.  In  fact,  the  system  becomes  nearly 
open-loop  through  the  feedforward,  with  the  feedback  acting  as  a  vernier 
control  and  as  a  means  of  stabilizing  the  controlled  element  when  needed. 

An  excellent  example  of  pursuit  activity  is  given  in  Fig.  which 
shows  the  YPi  generated  in  control  of  a  second-order  system  with  an 
unstable  divergence.  The  degree  to  which  the  ideal  Yp^Yc  =  1  can  be 
approached  in  practice  is  remarkable  for  the  amplitude  ratio,  although 
nowhere  near  as  close  in  phase. 

C.  lOUROMUBCUIAB  SUBSYSTEM 

Those  aspects  of  the  control  force  characteristics  involving  the 
pilot's  neuromuscular  system  as  a  closed-loop  actuation  system  are  subtle 
and  not  generally  understood.  Yet  they  can  be  exceptionally  important 
and  critically  limiting  in  such  matters  as 

•  Control  precision  where  limited  by  the  pilot's  neuromuscular 
system 

•  Effects  of  control  system  nonlinearities,  including  their 
connections  with  control  system  sensitivity  requirements 

Fortunately,  recent  research  on  human  pilot  dynamics  (e.g..  Refs.  18-26) 
has  revealed  enough  about  the  human  pilot  neuromuscular  characteristics 
to  allow  a  rational  approach  in  considering  such  factors. 

Although  the  details  of  t^e  human’s  actuation  system  for  even  the 
simplest  of  motions  are  enormously  complicated  from  a  component  standpoint, 
its  behavior  for  random-appearing  visual  inputs  and  spring- restrained 
manipulators  can  be  modeled  quite  well  using  the  equivalent  system  of 
Fig.  4.  The  details  of  the  "components"  in  this  system,  which  amount  to 
ensembles  of  neurological  sensing,  equalizing,  and  actuating  apparatus, 
are  beyond  the  present  scope  (see  Ref.  28),  although  some  features  are 
viiscussed  in  Section  VII-A.  The  net  results  of  their  actions  can  be 
treated,  however.  These  are  implicit  in  the  component  describing  functions 
for  the  elements  in  Fig.  4.  For  the  spindle  ensemble,  which  provides  in 
one  entity  the  feedback,  a  bias  adjustment,  some  adjustable  series  equal¬ 
ization,  and  the  source  of  one  command  to  the  system,  the  describing 
function  is  a  lead/lag,  i.e., 
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Figure  5.  Linb/Mtui pula  tor  Load  Dynamic* 
for  Pilot,'*  N*uronu*culkr  (Actuation)  Sy*tem 
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Tbs  relationships  in  Eq.  12  show  the  fundamental  effects  of  changes  in  the 
«t*ady-stat«  lnosetric  tension,  P0.  If  P0  is  increased,  the  high  frequency 
tine  constant,  Tfcjg,  is  decreased  and  the  low  frequency  time  constant,  Tj^  , 
is  increased.  In  the  process,  the  width  of  the  -20  db/decade  portion  of 
the  limb/manipulator  system  Bode  diagram  is  increased. 

A  variation  in  tension  causes  major  changes  in  the  neuromuscular 
subsystem  dynamics  and,  therefore,  in  the  over-all  dynamic  behavior  of 
the  human  operator.  The  general  nature  of  these  changes  is  indicated  for 
the  y  motor  neuron  command  input  by  the  surveys  given  in  Pig.  7.  These 
surveys  neglect  the  pure  time  delay,  Ta,  within  the  loop.  First,  for  a 
low  value  of  average  tension  (which  is  still  sufficient  to  make  over¬ 
damped)  the  closed-loop  dynemics  are  given  by 


Then,  with  an  Increase  in  tension  the  open-loop  plot  changes  to  that  shown 
for  high  tension.  The  closed-loop  dynamics  are  similar  in  form,  but  the 
looatlon  of  the  poles  has  changed.  The  basic  outcome  of  the  steady -state 
tension  increase  la  to  decrease  the  effective  time  delay,  Tr,  which  is 
approximately 

Tfc  •  +  (a!*) ' 

Accompanying  the  effective  time  delay  decrease  is  an  increase  in  the  very 
low  frequency  phase  lag  due  to  the  shift  in  1/Tr.  Thus  this  extremely 
simple  mechanism  models  the  simultaneous  variation  of  very  low  frequency 
phase  lag  and  effective  time  delay  observed  experimentally  (Refs.  12,  26). 

A  similar  type  of  analysis  follows  for  the  neuromuscular  system  response 
to  an  a  motor  neuron  command.  The  block  diagram  is  that  of  Fig.  8a.  The 
transfer  characteristics  are  giver,  approximately  by 

(aTj^s  +  l)e~TaB 

—  ce  - - - -  (1 1|) 

0x5  (T^s  +  l)(T^s  +  l)  [(aTK)'s  +  l] 

where  the  or  P2  subscripts  are  left  off  as  not  needed  in  this  context. 

The  numerator  time  delay,  e  a  ,  represents  the  effective  delay  in  the 
stretch  reflex  loop.  The  Bode  diagram  for  Eq.  1^  is  given  in  Fig.  8b. 
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Figure  7*  Root  Loci  jf  Neuromuscular  Subsystem  Dynamics  with  Two  Levels  of  Tension 


ac 


Figure  8,  Alpha  Motor  Neuron  Command  System 
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For  a  closure  with  increased  tension  (higher  gain)  in  the  limb  dynamics, 
the  crossover  for  the  over-all  closed-loop  system  will  occur  in  a  fre¬ 
quency  region  with  a  slope  of  -40  db/decade  as  shown.  Further,  to  the 
extent  that 

1  2.  1 

(aTjc) '  "  aTK 

the  a  motor  neuron  command  response  becomes  approximately 


ac  (tmt  8  +  ^  (tM£s  +  l) 


oc 


TMiTM2  fl2 
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D.  MCJUTZLOOF  PILOT  MODEL 

The  pilot  model  for  multiloop  tasks  is  an  extension  to  the 
qtua  si -linear  describing  function  model  for  single-loop  tasks  summarized 
above.  As  used  here  the  term  "multiloop”  refers  to  two  or  more 
interacting  loops;  control  tasks  involving  noninteracting  loops  are 
referred  to  as  "multiple-loop."  For  example,  pitch  and  bank  angle 
stabilization  in  straight  and  le  ;1  flight  is  a  multiple-loop  task,  while 
pitch  attitude  and  altitude  control  is  a  multiloop  task. 

Multiloop  tasks  involve,  in  general,  several  sensed  quantities  (e.g., 
pitch  attitude  and  altitude)  as  well  as  several  different  pilot  outputs 
(e.g.,  elevator  and  throttle).  The  inputs  to  the  pilot  may  be  perceived 
by  only  one  of  the  senses  (single  modality)  or  by  several  (multimodality). 
The  single -modality  case  —  visual  cues  only — is  discussed  in  subsection  1 
below.  Some  additional  factors  which  must  be  considered  in  the  multi¬ 
modality  situation  —  visual  and  motion  cues  —  are  outlined  in  subsection  2. 

Multiloop  tasks  can  also  be  classified  according  to  the  level  of  pilot 
activity  or  perceptive  structure.  As  in  single-loop  cases,  the  pilot  may 
operate  at  various  limits,  e.g.,  compensatory,  pursuit,  etc.  In  fact,  it 
is  possible  for  the  pilot  to  have  a  combination  of  levels,  e.g.,  compensa¬ 
tory  in  one  loop  and  pursuit  in  another. 
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To  avoid  a  lengthy  and  involved  presentation,  only  compensatory  behavior 
is  discussed  here.  The  ramifications  of  pursuit  or  precognitive  pilot 
behavior  can  be  Inferred  from  the  pertinent  single-loop  presentations. 

1 .  Single  Modality 

The  analysis  procedure  for  a  multiloop  control  task  with  only  visual 
cues  is  illustrated  in  Fig.  9*  The  information  required  at  initiation  of 
the  procedure  is  a  description  of  the  basic  task  or  mission  and  the 
environment  in  which  the  task  is  to  be  performed.  These  provide  the 
command/disturbance  structure  shown  in  Fig.  9  and  result  in  the  forcing 
function  specification.  Also  needed  initially  is  a  detailed  description 
of  the  vehicle  dynamics  with  any  associated  stability  augmentation. 

Possible  piloting  techniques  are  determined  by  combining  the  command 
and  vehicle  data  via  the  multiloop  extension  (Ref.  1  3)  to  the  single-loop 
pilot  model  described  above. 

The  application  of  the  pilot  model  for  multiloop  compensatory  systems 
then  allows  the  analyst  to  estimate,  for  given  command  structures  and  a 
given  set  of  controlled  element  dynamics: 

•  Possible  competing  sets  of  pilot  loop  closures. 

•  Pilot  dynamics  in  term3  of  the  pilot  describing 
function  for  each  of  the  loops  closed. 

•  The  closed-loop  dynamics,  such  as  the  system  output 
to  command  input  describing  function. 

•  That  portion  of  the  closed-loop  average  performance 
due  to  the  pilot's  linear  operations  on  the  forcing 
function.  Less  accurate  estimates  can  be  made  for 
that  portion  of  the  system  mean- squared  error  due 
to  the  pilot ' s  remnant . 

•  Closed-loop  error  spectrum,  including  an  estimate 
for  the  effective  bandwidth. 

•  Ratios  of  crossover  frequencies  for  the  various  loops 
closed  by  the  pilot. 

•  Relative  bandwidths  for  each  of  the  loops  closed. 

In  other  words,  for  compensatory  systems  at  least,  a  great  deal  of 
information  about  possible  system  structures,  pilot  and  system  dynamics, 
and  average  performance  can  be  estimated. 
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VEHICLE  STRUCTURE 


£.  Mttltlaodality 


The  vestibular  apparatus  comprising  the  semicircular  canals  and  the 
utriculus  is  probably  the  most  important  primary  motion  response  sensor. 
The  canals  have  a  basic  second-order  response  tc.  angular  acceleration 
which  is  highly  overdamped  and  effectively  provides  a  signal  proportional 
to  turn  rate  over  the  frequency  range  from  0.1  to  10  rad/sec  (Ref.  2?) . 

For  prolonged  turning  the  signal  "washes  out"  so  that  spurious  sensations 
occur  when  the  turning  motion  stops.  The  utriculus  provides  signals  pro¬ 
portional  to  linear  accelerations  and  any  washout  characteristics  it  may 
have  are  not  well  documented. 

The  proprioceptive  sensors  in  the  neuromuscular  system  are  of 
demonstrated  importance  to  the  dynamics  of  the  actuator  response  charac¬ 
teristics.  Also,  the  muscle  spindles  may  be  used  to  generate  lead  at  the 
subcortical  level.  While  such  effects  are  important  in  characterizing 
pilot  dynamics,  they  don't  seem  to  be  of  particular  significance  in  percep¬ 
tion  of  motion.  A  possible  exception  is  the  extraocular  neuromuscular 
system  response  in  nystagmus. 

The  nystagmic  crossfeeds  produce  involuntary  eye  motions  as  a  function 
of  the  excitation  of  the  vestibular  apparatus.  Such  motions  are  known  to 
be  important  in  disorientations  and  illusions  which  result  from  the 
initiation  or  sudden  cessation  of  large  amplitude  maneuvers  (e.g.,  Ref.  50) 
and  other  flight  operations  which  have  no  ordinary  earthbound  equivalent. 
Several  important  motion  effects  of  this  nature  are  summarized  in  Table  IV. 

Figure  10  shows  a  much  Simplified  block  diagram  of  the  sensory  feedback 

and  crossfeed  paths  for  visual  and  vestibular  cues  (see  also  Ref.  31). 
lliere  are  obviously  many  ways  in  which  the  various  loops  can  be  closed, 
but  we  will  hypothesize  that  the  functions  are  adjusted  so  that  a  "good" 
control  system  is  obtained.  This  hypothesis  is  consistent  with  indica¬ 
tions  that  a  well-trained  pilot  Beems  always  to  achieve  near-optimum 
adjustments  of  the  exterior  loops  under  his  cognizance.  That  is,  he 
picks  the  same  feedbacks  and  roughly  the  same  gains  and  (limited)  equal¬ 
ization  that  a  competent  controls  engineer  would  select.  Such  an  approach 
to  the  block  diagram  of  Fig.  10  is  perhaps  optimistic  in  that  different 
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LES  OF  KEY  MOTION  EFFECTS  IN  THE  PILOT /VEHICLE  SYSTEM 


• 

J 

sensations  are  involved,  the  ways  in  which  these  "mix"  are  not  quanti¬ 
tatively  known,  and  relatively  inflexible  crossfeeds  are  present.  Also, 
the  transfer  characteristics  of  some  of  the  "blocks"  nay  be  highly  non¬ 
linear  or  otherwise  poorly  defined.  Nevertheless,  systems  analyses  which 
show  the  potential  influence  of  motion  effects  while  recognizing  some  of 
these  uncertainties  can  at  least  serve  as  a  useful  guide. 

E.  RESTRICTIONS  ON  QUASI- LINEAR  MQDEIfl 

The  quasi-linear  models  have  a  number  of  important  shortcomings. 

Those  which  restrict  their  usefulness  and  generality  in  situations  to 
which  they  are  normally  and  quite  properly  applied  are  discussed  below. 

Those  shortcomings  which  make  them  unsuitable  at  their  current  state  of 
development  for  describing  pilot  response  in  other  control  situations 
are  discussed  in  some  detail  in  Section  III,  where  they  are  called 
"deficiencies. " 

1 .  Station* rity 

The  control  situation  is  assumed  to  be  stationary.  This  implies  that: 

The  forcing  -function  is  a  stationary,  random-appearing 
process. 

•  The  controlled  element  characteristics  are  time -invariant. 

Only  time-averaged  or  statistical  properties  of  the  pilot  can  be 
derived  because  of  the  random  nature  of  the  tracking  process. 

As  a  result,  the  describing  function  data  express  his  average  behavior 
over  periods  greater  than  at  least  5  —  10  sec  duration.  The  short  term 
variations  in  behavior  are  not  represented  in  that  portion  of  the  pilot 
model  which  is  linearly  correlated  with  the  forcing  function. 

Sophisticated  subjects  who  have  been  trained  to  temporarily  stable 
performance  levels  are  used  in  order  to  enhance  the  repeatability  of 
the  measurements  and  to  better  represent  skilled  performance  in  flight 
control  tacks.  These  subjects  (frequently  test  pilots)  are  well  adapted 
to  the  control  situation,  but  are  not  necessarily  at  their  limits  of 
learning.  The  learning  effect  can  be  treated  when  necessary  (e.g.,  Ref.  32) 
by  considering  frozen  increments  in  a  long  term  (days  to  years)  learning 
process,  with  each  increment  a  different  quasi-linear  situation. 
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2.  Control  Strategy  or  Criterion 


Subjects  in  the  behavioral  measurement  programs  from  which  the 
quasi-linear  models  derive  were  instructed  to  reduce  or  maintain  system 
errors  within  acceptable  (near  minimum)  bounds.  Instructions  to  the 
subject  to  minimize  or  constrain  other  state  or  control  variables  can 
result-  in  significantly  different  control  strategies  and  data  (Refs.  33 
and  3^) . 
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lk»rioi«*»\oi«n  In  *h»  quasi -llnwu’  models  nr*  examined  her*  In  n «.vhmt 
detail  i  u  define  those  ureas  when?  &  new  approach  to  pilat/vehiei*  dynamic 
analysis  1  m  needed.  The  quasi-linear  context  serves  only  »«  11  convenient, 
imiw  of  reference ,  And  It,  is  not  Intended  to  suggest  a  short, -lighted 
ut.look  toward  alternative  methodulogies,  On  the  contrary,  An  Intimate 
lamlLlailty  with  the  many  shortcomings  of  UuM.  model  only  server*  to  moti¬ 
ve  t,e  more  strongly  the  drive  far  new  approaches  and  aolutione  to  critical 
uneolved  problems. 

The  nummary  of  new  approaches  in  the  form  of  possible  methods  u.r 
modelr  to  relieve  deficiencies  is  presented  in  Table  V-  The  classifica¬ 
tion  headings  are  assigned  according  to  quasi-linear  model  deficiencies 

in  •  Control  situations 

•  Structural  connections 

•  Application 

The  "control  nituation"  refers  to  the  combination  of  the  system  of  which 
the  pilot  iu  a  component  and  the  external  environment  within  which  he  is 
attempting  to  accomplish  a  control  task.  Some  examples  of  manual  control 
situations  corresponding  to  the  theoretical  classifications  used  in  Table  V 
are  given  in  Table  VI.  The  "structural  connection"  classification  refers  to 
mechanisms  and  information  flow  internal  to  the  pilot.  Deficiencies  classed 
according  to  "application"  relate  to  known  problems  encountered  in  applying 
quasi-linear  models  to  the  study  of  handling  qualitie  of  manual  control. 

The  nature  of  the  deficiency,  be  it  fundamental  or  resolvable,  is 
given  in  Table  V  when  known.  Possible  new  approaches  to  modeling  the 
phenomenon  are  given  when  the  deficiency  is  fundamental.  When  the 
deficiency  appears  to  be  resolvable,  puseible  extensions  or  improvements 
to  the  quasi-linear  form  are  noted,  as  well  as  any  applicable  new  methods 
or  models.  The  "Remarks”  column  provides  clarification  of  the  deficiency 
and/or  amplification  of  the  possible  new  approaches  to  the  problem. 
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TABLE  V  ( Continued.) 


The  entries  in  Table  V  are  intended  to  make  it  comprehensive,  and  not 
all  the  deficiencies  are  capable  of  correction  by  new  models  or  methods. 
Interest  in  this  report  is  addressed  primarily  to  models  which  hold  some 
promise  for  alleviation  of  deficiencies  noted  by  an  asterisk  in  Table  V. 


TABU  71.  EXAMPLES  07  CONTROL  SITUATIONS 


CONTROL  SITUATION 


Nonstationary  forcing 
function  or  disturbances 


EXAMPLES 


Engine  failure;  discrete  gust  (shear 
or  gradient) ;  discrete  terrain 
feature 


Sudden  Yc  transition 


Stability  augmenter  failure;  stage 
separation  of  space  booster;  tran¬ 
sition  to  visual  during  IIS  approach 


Patterned  responses 


Procedural  turns;  sidestep  maneuver; 
landing  flare  and  decrab;  VTOL  tran¬ 
sition;  bank-and-stop;  etc. 


Other  control  strategies 


Terminal  control:  landing;  gunnery 
runs;  dive  bombing;  orbital  rendez¬ 
vous  and  docking;  satellite  attitude 
changes 


Nonlinear  Yc,  constant 
coefficient 


Satellite  attitude  stabilization 
with  on-off  controls 


Certain  of  the  Table  V  model/methods  are  under  active  investigation 
in  other  research  programs,  and  these  will  not  be  included  in  this  report. 
Cne  example  is  the  mode-switching  model  for  step  transitions  in  the  con¬ 
trolled  element  dynamics,  which  is  fairly  well  developed  and  has  been 
documented  (Ref.  36) .  Results  of  other  studies  of  the  effect  of  non- 
stationarity  in  the  system's  dynamics  on  the  pilot's  response  are  given 
in  Refs-  36  through  . 
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A.  DATA  TO  BIG  EXPLAINED 

The  pilot  response  characteristics  for  systems  which  require  low 
frequency  pilot  lead  are  fundamentally  different  from  those  characteris¬ 
tics  exhibited  in  systems  which  do  not  need  such  lead  equalization.  When 
low  frequency  lead  is  not  present,  as,  for  example,  with  the  controlled 
elements  Yc  =  Kc  and  Yc  =  Kc/s,  the  pilot  responses  are  essentially  smooti 
and  uniform  when  the  controlled  element  gain  values,  Kc,  fall  anywhere 
within  a  fairly  broad  range  about  the  respective  optimum  gains.  Inputs 
which  have  Gaussian  amplitude  distributions  give  rise  to  pilot  output 
amplitudes  which  are  also  Gaussian;  and  the  general  character  of  the 
response  is  akin  to  that  of  a  constant-coefficient  linear  system  with 
occasional  very  short  (about  1  /4  —  1  /3  sec)  horizontal  flat  stretches  (see 
Figs.  11  and  12)  which  give  a  discrete  appearance  to  those  portions  of  the 
response.  Not  only  does  the  pilot  response  qualitatively  resemble  that  of 
a  linear  system,  but  the  describing  function  portion  alone  of  the  quasi - 
linear  model  accounts  for  more  than  8o  percent  of  the  total  output  power. 
Also,  the  adjustments  rules  are  easily  and  accurately  applied  to  the  pre¬ 
diction  of  describing  functions  for  specific  controlled  elements  and 
sufficient  remnant  data  exist  to  enable  a  first-order  estimate  of  the 
output  power  due  to  that  component.  Consequently,  for  most  engineering 
purposes  we  can  be  generally  satisfied  with  extant  quasi-linear  models  in 
situations  not  requiring  low  frequency  pilot  lead. 

We  cannot  be  so  content,  nowever,  when  low  frequency  lead  is  needed 
to  stabilize  the  system,  as  with  controlled  elements  which  approximate 
Yc  -  Kc/s2  or  Kc/sJ  in  the  frequency  region  about  the  pilot/vehicle  system 
crossover.  Associated  with  the  lead  generation  is  a  marked  difference  in 
the  character  of  the  human's  output  from  that  exhibited  when  this  lead  is 
not  present.  For  instance,  the  pilot's  output  is  more  discrete  and  pulse¬ 
like  in  nature  (see  Fig.  15),  and  the  output  amplitude  distributions  are 
not  Gaussian.  Quasi-linear  models  are  still  appropriate  to  describe  the 
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gross  on-the-sverage  behavior,  but  leave  much  to  be  desired  for  more 
detailed  and  fine-grained  descriptions.  The  purpose  of  this  section  is 
to.  present  models  which  are  attempts  to  account  for  more  of  the  fine¬ 
grained  detail  in  the  low  frequency  lead  situation. 

To  be  pertinent,  the  models  to  be  constructed  should  be  compatible 
with  existing  data  (e.g.,  that  of  Ref.  12).  These  include: 

Amount  Of  low  frequency  lead.  The  low  frequency  lead  is  adjusted  such 
that  the  open-loop  amplitude  ratio  I YpYc I ^  approximates  a  —20  db/decade 
slope  over  a  very  wide  range  of  frequencies  about  crossover.  For  second- 
order  controlled  elements  the  lead  is  represented  in  the  pilot  describing 
function  by  the  factor  T^jco+I;  the  value  of  Tl  is  selected  either  to 
cancel  approximately  a  controlled  element  lag  [e.g.,  when  Yc  =  Kc/s(Trs+1), 
TL  =  TrJ  or  to  be  very  large  [e.g.,  Tl  >  5  sec  for  Yc  =  Kc/s2  or  Kc/s(s-a)]  . 
For  the  latter  case,  the  frequency  range  available  of  measurements  is 
insufficient  to  enable  a  pure  lead,  TjJoo,  to  be  distinguished  from  a  lead 
factor,  Tl^oi  +  I.  Similar  nearly  pure  second-order  leads,  (T^ao)2,  appear 
to  be  present  for  Yc  =  Kc/s 5. 

Increased  effective  time  delay.  The  "crossover  model"  represents  the 
dynamics  of  single-loop  systems  by  the  simplified  open-loop  describing 
function 


-  Ax(o)i) 


Here  cjoc  has  been  approximated  by  uCo  =  jt/2x0(Yc)  as  discussed  at  the  top 
of  page  11.  That  part,  x0(Yc),  of  the  effective  time  delay,  xe,  which 
depends  on  the  controlled  element  is  larger  for  systems  requiring  low 
frequency  lead.  Nominally,  x0  =  1 /3  sec  without  and  1/2  sec  with  (first- 
order)  low  frequency  lead. 

Amplitude  distributions  Of  pilot  output.  When  maximum  values  of  low 
frequency  lead  are  present,  the  pilot's  output  amplitude  distributions 
are  non-Gaussian.  Typically,  these  are  bimodal  distributions  (Fig.  1 4) 
which  reflect  the  pulsing  nature  of  the  output.  The  degree  of  bimodality 
depends  primarily  on  the  particular  subject. 


YpYc(  j(n)  = 
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X&orttaod  remnant.  Other  things  being  equal,  when  the  low  frequency 
lead  is  present  tfcV  amplitude  of  the  remnant  power  spectral  density  is 
larger  than  otherwise. 

Nature  Of  the  response.  With  near-optimum  controlled  element  gains, 
the  pilot's  output  motions  appear  more  discrete  and  pulselike  when  large 
low  frequency  leads  are  present  (cf.  Figs.  13  and  15). 

In  the  following  sections  two  basically  different  models  for  lead 
generation  are  presented.  The  first  starts  with  the  development  of  a 
hypothetical  model  for  the  detection  of  stimulus  velocity  which  is  made 
plausible  by  comparison  with  velocity  threshold  data.  Only  the  signs  of 
the  velocity  so  detected  are  then  used  as  the  basis  for  pulsing  output 
motions  of  the  pilot.  The  output  motions  are,  accordingly,  similar  to 
the  style  shown  in  Fig.  15*  For  this  model  the  primary  remnant  source  is 
the  high  frequency  output  implicit  in  the  pulses;  secondary  sources  are 
gain  variations  which  result  in  the  distribution  of  pulse  amplitude  about 
idealized  average  values,  and  stimulus  velocity  detection  time  computation 
variations.  The  second  model  developed  operates  from  stimulus  position 
rather  than  rate,  and  uses  a  store  of  past  stimulus  values  to  create  a 
differential  signal.  The  differential  position  signal  then  triggers  an 
output  pulse  which  has  an  area  proportional  to  the  stimulus  increment. 

The  output  motions  here  are  similar  to  those  shown  in  Fig.  13-  For 
simplicity  this  model  is  idealized  as  a  constant-rate  sampled-data  system, 
although  some  random  variation  in  sampling  rate  is  necessary  to  be  compatible 
with  actual  remnant  data  which  do  not  exhibit  the  periodicities  expected 
from  constant  rate  sampling.  The  remnant  sources  for  this  model  are,  again, 
implicit  in  the  pulselike  nature  of  the  output,  any  gain  variations  through¬ 
out,  and  the  random  sampling  variations.  For  both  models  it  is  convenient 
to  think  of  lead  generation  as  a  separate  channel  within  the  human  operator 
lying  in  parallel  with  the  more  proportional  channels  used  in  control  of 
Kc  and  Kc/s-like  controlled  elements.  The  parallel  channels  join,  of 
course,  at  or  slightly  before  the  final  common  path  through  the  neuro¬ 
muscular  system. 
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i.  vKociw-sneiiw  modxl 


1 .  The  Modal  a  Whole 

For  tin'  velocity  Input  mute  I  of  low  frequency  leud  generation,  t  he 
stimulus  velocity  Jn  considered  to  be  n  fundamental  sensory  modality  At 

the  init.iul  stage  of  the  vi muil  process  neither  t.he  rods  nor  the  cores 
luive  velocity  as  a  specific  stimulus,  tut  several  (Hagen  farther  along  at 
t.he  optic  nerve  output  of  the  eye  1  t.ue 1 1'  there  are  gHiiglton  celLs  with 
diocliargen  which  nre  functions  of  stimulus  velocity.  Between  the  baric 
sensors  and  the  optic  nerve  there  are  both  bipolar  and  horizontal  cello 
which  nerve  an  summation  loci  for  the  discharges  1'roru  trnny  rodu.  The 
enormous  sensing  and  computing  cnjiaelty  avullnhle  (lCv'  rodr.  and  ox  1 0* ’ 
conec  converging  via  bipolar  and  horizontal  edit;  on  about  10*’  >jmiglion 
cells  feeding  the  optic  nerve  fibers)  certainly  provides  adequate  capacity 
for  the  computation  of  velocity  within  the  retina  itself.  The  velocities 
no  attained  will,  however,  incur  a  penalty  in  delay.  As  will  be  shown  in 
the  next  article,  the  delay,  ‘f | ,  will  depend  on  the  variance  of  the  Input 
velocity.  For  complex  stationary  signals  the  avexttge  delay  will  depend 
on  the  spatial  characteristics  of  the  signal  as  projected  on  t.he  retinal 
field.  For  the  very  Glmple  model  propoued  here  a  signal  proportional  to 
velocity  is  not  required;  instead,  only  an  indication  of  the  sign  of  the 
velocity,  albeit  delayed,  is  needed.  This  is  consistent  with  the  approxi¬ 
mately  constant  amplitude  output,  pulsen  of  Fig.  15  (although  not  with 
other  operator  "styles").  The  first,  or  velocity-Bensing  stage  of  the  model 
then  lias  input  and  output  characteristics,  depicted  in  Fig.  lo  in  the  first, 
and  third  lines . 

In  the  remainder  of  the  process  the  additional  time  delays  due  to 
conduction  and  coding  delays  in  signal  transmission  and  to  lagB  in  the 
neuromuscular  actuation  system  will  ail  be  represented  by  a  pure  time 
delay,  e  as  the  low  frequency  approximation.  The  neuromuscular 

system  portion  of  this  is  replaced  with  higher  order  approximations. 
Finally,  connecting  the  sensed  velocity  signal,  sgn  e(t.  —  T.  j ) ,  with 
pilot  output,  we  shall  use  a  simple  gain  proportional  to  the  mis 
velocity  input.  The  idealized  pilot’s  output  will  then 
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Ing  Lead  Generation  Model 


be  boxes rJike  in  iiature  with  a  magnitude  proportional  to  the  nne  Input, 
velocity  and  axis  crossings  which  coincide  with  the  sign  changes  of  the 
detected  velocity.  The  pilot  output  is  shown  in  line  4  of  Fig.  lb;  if 
higher  order  approximations  are  used  for  the  neuromuscular  system,  the 
output  velocity  changes  would  be  accomplished  with  finite  accelerations 
and  velocities,  and  the  sharp  corners  would  be  rounded.  A  block  diagram 
showing  the  idealized  system  is  given  In  Fig.  1 7. 


Visual  Processes 


Figure  17«  Block  Diagram  for  Velocity-Sensing  Lead  Generation  Model 


The  pilot  output  ns  a  function  of  time  ic  given  by 

c(t  +  Ta)  =  Klov  sgn  v|t  -  Td(v)]  (17) 

where  e  «  v  is  used  for  convenience.  If  the  stimulus,  e(t),  is  presumed 
to  have  a  Gaussian  amplitude  distribution  and  if,  further,  the  velocity 
detection  delay  time,  T^,  is  taken  as  an  average  value  which  will  be  a 

p 

function  of  the  variance,  oy,  of  the  input  velocity,  then  the  output  can 
be  written  as 

c(t  +  Ta)  *  K ipv  sgn  v[t  -  Td(ov)j  (18) 

The  Gaussian  input  describing  function  between  the  pilot  stimulus,  e(t), 
and  pilot  output,  c(t),  will  then  be 


Till!)  describing  function  has  the  appropriate  fora  for  low  frequency  lead 
generation,  and  also  exhibits  a  time  delay  increase,  i.e.,  over  that 
(T/J  which  would  be  present  in  a  proportional  channel.  Thus,  the  charac¬ 
teristic  time  difference  between  situations  with  and  without  low  frequency 
lead  is  accounted  for  qualitatively. 

The  constant -amplitude  output  pulses  provided  In  this  model  result  in 
sharply  peaked  bimodal  amplitude  distributions.  These  are  compatible  with 
the  outputs  generated  by  some  subjects,  but  by  no  means  all,  e.g.,  compare 
Figs.  13  and  1  lj>.  The  model  as  it  stands  will  not,  accordingly,  be  suit¬ 
able  for  those  subjects  whose  output  amplitude  distributions  arc  flatter 
or  more  Gausslanly  distributed.  To  account  for  these  we  can  use  the 
constant-amplitude  output  model  as  an  average  characteristic  and  add  a 
random  fluctuation  about  this  average.  For  example,  an  increment,  Ac(t), 
which  is  constant  for  each  pulse,  independent  of  all  other  increments, 

normally  distributed,  and  for  which  the  expected  value,  EjAc^j,  is  proper¬ 
's 

tional  to  ay  would  provide  a  simple  process  which  could  be  tailored  to 
account  for  less  clear-cut  and  sharp  bimodal  characteristics.  More  complex 
schemes  are  also  possible. 

2 .  Velocity  Detection 

The  means  available  within  the  retina  to  detect  stimulus  velocity  has 
been  hinted  at  above.  In  this  article  we  shall  make  the  mechanism  con¬ 
ceptually  more  concrete  by  proposing  a  very  simple  model  which  is  made 
plausible  by  comparison  with  existing  data. 

The  simplified  model  has  two  basic  levels,  as  shown  in  Fig.  18.  At 
the  stimulus  end  is  an  ensemble  of  basic  "receptive  field  sensors,"  all 
impinging  on  a  single  ganglion  cell.  The  axon  of  the  ganglion  cell  is 
one  of  the  fibers  in  the  optic  nerve.  Each  "receptive  field  sensor"  is 
made  up  of  a  variety  of  rod  (and/or  cone)  cells  connected  to  a  single 
bipolar  cell.  This  view  is  similar  to  that  advanced  In  Ref.  48. 

In  the  simplified  model  the  pilot  stimulus  is  assumed  to  be  moving 
across  the  retina  with  a  constant  velocity,  v.  The  illumination  from  the 
stimulus  is  presumed  to  be  large  enough  to  activate  each  receptive  field 
in  turn  as  it  passes  through  that  field  of  influence.  If  but  one  action 
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potential  is  generated,  in  a  bipolar  cell  by  the  encounter  of  the  visual 
stimulus  with  each  receptive  field,  and  if  the  fields  served  by  these 
bip  ilar  cells  are  separated  on  the  average  by  a  distance  d,  then  the  net 
input  to  the  ganglion  cell  will  be  approximately 

xr(t)  =  6(t)  +  +  ...  +  6|t-£pJ  +  ••■ 

■  lo°K)  (20) 

Here  each  action  potential  is  represented  by  a  delta  function  and  the 
voltage  scales  are  normalized  on  a  per  unit  action  potential  basis.  If 
all  the  action  potentials  are  assumed  to  have  equal  weights,  and  if, 
further,  the  effective  weighting  function  of  the  ganglion  cell  to  an 
individual  action  potential  input  is  Wg(t),  then  the  subthreshold  electric 
potential  in  the  ganglion  cell  due  to  the  activity  of  its  associated 
sensory  and  bipolar  cells  will  be 


=  X)  r1  Wg(T)&[t-~ -t|  dx  (21) 

n=0  **0  1  J 

The  general  upper  rrr.ce  of  the  subthreshold  potentials  will  look  like  those 
shown  in  Fig.  19>  where  Tg  is  a  representative  time  constant  of  the  ganglion 
cell's  weighting  function.  In  Fig.  19a  the  time  interval  between  the 
stimulus  exciting  receptive  field  (T)  and  that  exciting  receptive  field  (5) 
is  large  relative  to  the  time  constant  of  the  ganglion  cell.  The  resulting 
ganglion  cell  potential  is  then  a  sequence  of  well-separated  weighting 
function  responses  to  each  of  the  sensory  action  potentials  in  sequence. 
Because  the  maximum  value  of  the  weighting  function  is  sub  threshold,,  the 
ganglion  cell  will  not  discharge  and  the  visual  event  i.»  recorded  only  in 
the  local  potential  and  in  the  underlying  action  potentials  of  the  rods 
(cones)  and  the  bipolar  cells,  and  nowhere  farther  downstream.  On  the 
other  hand,  when  the  time  between  receptive  field  discharges  is  of  the 
same  order  or  smaller  than  the  ganglion  cell  time  constant,  as  in  Fig.  19b, 


46 


Figure  IQ.  Bipolar  Cell  Subthreshold  Potentials 


part  of  the  activity  of  fields  (7)  and  (2)  are  summed  with  that  of 
field  (3),  etc.,  to  create  a  ganglion  cell  potential  greater  than  the 
weighting  function  maximum.  When  this  summation  potential  is  equal  to 
the  threshold  oi  the  ganglion  cell,  the  cell  will  fire.  This  passes  on 
to  higher  centers  the  information  that  an  object  with  velocity  above  a 
certain  value  lias  appeared  in  the  field  of  view  served  by  the  ganglion 
cell  and  its  associated  lower  level  sensory  and  bipolar  cells.  Ao<'ve  the 
threshold  the  ganglion  cell  pulse  rate  will  presumably  be  proportional  to 
the  rate  of  arrival  of  bipolar  cell  action  potential';,  thereby  providing 
some  indication  of  the  magnitude  as  well  as  the  }  resenee  of  the  Input, 
stimulus . 

To  obtain  a  me  them  t.  leal  description  of  this  process  we  shall  derive 
below  an  approximate  expression  for  ganglion  cell  potential  due  to  the 
input  stimulus.  Then  for  the  condition  where  the  cell  potential  Just 


barely  exceeds  its  threshold  we  can  connect  the  input  velocity  with 
detection  time.  The  first  step  in  this  process  is  to  approximate  the 
ganglion  cell  weighting  function,  wg(t) ,  as  a  first-order  exponential 
response  such  as  that  shown  in  Fig.  20,  and  then  further  approximate 


Figure  20.  Approximate  Bipolar  Cell  Weighting  Function 


this  by  the  simple  triangle,  i.e., 

wg(t)  =  e”'t/Tg 

=  1  -  sr  ,  0  <  t  <  Tg  (22) 

Tg 

=  0  elsewhere 

When  the  triangular  approximation  is  used,  only  the  N  pulses  in  an  inter¬ 
val,  Tg,  need  to  be  considered  in  the  summation.  Then  over  an  interval, 
Tg,  the  cell  potential  will  be  approximately 

Xg(t)  =  ws(t-T)u(t-f ) 


kb 


where  N  is  the  largest  integer  in  the  Tg(v/d).  In  a  somewhat  different 
form  the  ganglion  cell  potential  will  be 
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The  waveform  is  a  complex  sawtoothlike  shape  as  illustrated  in  Fig.  21  . 


The  various  local  maxima  corresponding  to  the  tooth  tips  are  given  by 


or,  changing  the  variable  to  t*  =  t/Tg  and  letting  a  =  Tg(v/d), 

vH.**  =  (’  +ati  (’  --H  '26> 

If  a  <  l/2,  Xg(t* )jmav  is  a  monotonically  decreasing  function,  so  the 
velocity  cannot  be  detected  if  more  than  one  spike  needs  to  be  summed  in 
the  ganglion  cell  to  trigger  it. 

If  the  threshold  of  the  ganglion  cell  is  equal  to  a,  then  the  normal¬ 
ized  detection  time,  T^,  will  be  such  that  Xg(T^)  ^  a.  The  minimum  detection 
time  will  occur  when  this  inequality  is  an  actual  equality,  and  then 

Xg(Ti)  =  a  =  (l  +  aT^I  -  (27) 


The  solution  for  normalized  detection  time  is 


If  the  roots  of  the  quadratic  are  real  and  widely  separated,  they  are 
approximately 


Only  the  first  answer  depends  on  the  '■.hreshold,  which  is  an  obvious 
requirement  for  a  solution,  so  it  is  the  one  accepted.  Converting,  now,  to 
an  angular  velocity,  ft,  by  introducing  the  lens -to -retina  distance,  m,  and 
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converting  back  to  real  time,  the  detection  time  becomes 


2Ts(a-l) 

Td  =  TdiTg  =  (Tgv/d  -  1/2 ) 

Tg(a  -  1 ) 

"  TginH/d  -  l/2 

or,  if  a  is  considered  to  be  much  larger  than  l/2. 


or 


g(a-  1  )d/m 

n 


Tdn 


2(a-l)  ± 


Constant 


(50) 


(31) 

(32) 


This  implies  a  hyperbolic  relationship  of  detection  time  with  input 
velocity  for  constant- velocity  inputs. 

Experimental  data  which  support  the  hyperbolic  detection  time  velocity 
variation  can  be  drawn  from  Ref.  U9.  In  tests  reported  there  the  subjects 
were  required  to  identify  the  direction  and  time  of  recognition  of  the 
motion  of  a  target  light  relative  to  a  reference  light.  The  experiments 
were  conducted  in  a  planetarium  environment  with  a  star  background;  the 
reference  was  one  such  star  and  the  object  a  similar  light  spot  with  a 
known  initial  position  relative  to  the  reference.  The  test  chamber  was 
dark  except  for  the  objects  projected  on  the  inside  wall  of  the  planetarium. 
These  consisted  of  lOo  simulated  stars  of  approximately  fifth  magnitude 
plus  the  moving  object  which  was  slightly  brighter  than  the  background 
stars.  The  subjects  were  all  dark-adapted,  and  each  subject  used  a  stop¬ 
watch  to  measure  the  time  he  required  to  detect  object  motion.  The  experi¬ 
mental  variables  included  different  object  separations  and  directions. 

Figure  22  shows  the  results  of  one  series  where  simple  left/right  motion 
was  used.  The  angular  velocity  is  plotted  against  the  average  recognition 
time,  Tr,  for  the  six  subjects.  The  initial  separation  distance  for  these 
data  was  about  2°  ( mrad)  and  the  difference  between  motion  to  the  right 
or  .left  was  insignificant.  Other  experiments  with  different  initial  separa- 
i.lonn  and/or  directions  showed  that  in  general  both  separation  and  motion 
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Figure  22.  Velocity  Detection  ThreahoM  as  Function  of  Object  Motion 


direction  effect  the  results,  but  the  aame  general  trend  of  angular 
velocity  versus  recognition  tine  was  present. 

A  linear  fit  is  appropriate  to  the  data  of  Fig.  22,  which  on  these 
coordinates  indicates  a  hyperbolic  variation.  A  second  curve  is  alno 
fitted  to  take  into  account  the  experimental  observation  that,  recognition 
tine  did  not  change  for  speeds  greater  than  1 .6  mrad/sec.  The  exact 
location  of  this  asymptote  and  the  variation  and  form  of  transition 
between  constant  recognition  time  and  the  inverse  variation  cf  recogni¬ 
tion  time  with  angular  velocity  is  not  too  well  defined,  so  an  elementary 
fora  is  used  for  simplicity.  The  empirical  data  are  then  summarized  by 
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To  l.li*  pxt.on'  recognition  time  iu  proportloiin  1  to  Uwtnoi.lon  time, 

the  T,p.'  ~  conn  tin  it  connequence  of  the  nimplifled  velocity  detection  model 
io  ,|iuM  1  . 

Oiip  ol'  tin?  Important  defielenelen  in  the  existing  data  la  tliat  only 
constant  velocities  linvc  bean  ouauidered.  If  the  ui.iniuiun  movement,  ie 
winutioidAi  or  mndom,  the  effective  time  deiny  for  defection  will  be  quite 
different,  from  t.lu»t.  developed.  If,  however,  the  tiimple  model  presented 
i»  used  as  the  basis,  a  sinusoidal  motion,  for  exnmple ,  can  be  applied 
at.  the  input  and  the  output  of  the  bipolar  cell  estimated.  Thin  output 
can  then  be  reaolved  into  a  Fourier  series  and  an  average  detection  time 
defined  on  the  basic  of  the  phase  shift  bo tween  the  fundamental  and  the 
utimuluo  sinusoid.  The  calculation  ia  quite  involved  and  also  requires 
an  estimate  for  Tg,  the  typical  time  constant  of  the  ganglion  cello.  To 
avoid  this  an  approximate  scheme  in  which  the  constant -velocity  data  can 
be  uoed  directly  ie  indicated.  What  we  sliall  do  is  to  replace  the  sinu- 
aoid  by  an  equivalent  square  wave  for  which  the  tsinuBOid  is  the  fundamental. 
On  this  basis  the  equivalent  velocity  will  be 

neq  =  -J-  uA  (35) 

An  average  recognition  time  for  the  sinusoidal  input  would  then  be  com¬ 
puted  using  this  0eq  for  H  in  Eq.  33  or  ^ . 

C  •  DUFBRBNT1AL  DIBPIACMERT  MODEL 

In  the  differential  stimulus  displacement  model  for  low  frequency 
lead  generation,  the  stimulus  displacement,  e,  is  considered  to  be  the 
fundamental  sensed  entity.  The  bases  for  lead  generation  are  computa¬ 
tions  using  present  and  a  store  of  past-  stimulus  values  to  create  a 
differential  signal.  The  differential  displacement  signal  then  triggers 
an  output  pulse  which  has  an  area  proportional  to  the  differential 
stimulus  increment. 

Examination  of  Fig.  15  makes  plausible  the  statement  that  the  pilot 
output  pulses  are  composites  of  one  or  more  elementary  pulses,  each 
having  a  Width  of  about  l/5  sec.  In  the  simplest  Idealization  of  the 


pilot,  output  style  typified  by  Fig.  the  elementary  pulse  widths  are 
ascumed  constant,  thereby  requiring  pulse  amplitude  variations  to  achieve 
a  pulse  output  area  proportional  to  the  stimulus  increment. 

A  zero-order  hold  sampled-data  system  offerc  u:  ppropriato  starting 
pvji.'t.  to  amount  f«'r  the  ^lnt  t.ep"M  'i1' ."crate  nuisellke  In  the 

output.  Ideally,  for  simplicity  this  model  would  involve  constant-rate 
sampling.  Similar  considerations  to  these  led  to  earlier  versions  of 
constant-rate  sampled -data  models  for  human  operators  (Refs.  r>0-r>2.) 

From  the  look  of  Figs.  11-13,  this  could  be  made  a  reasonable  approxima¬ 
tion  for  a  few  seconds,  at  least  for  this  subject  and  manipulator.  The 
remnant  for  a  constant-rate  sampled-data  system  excited  by  a  Bum  of  sinu¬ 
soids  should  exhibit  periodicities  at  oth* r  than  the  forcing  function 
frequencies.  Since  this  is  not  observed  un  run  lengths  of  20  Bee  or 
greater,  some  variation  in  sampling  rate  is  necessary  if  a  sampled-data 
model  ir>  to  be  compatible  with  existing  remnant  data.  A  random  variation 
in  sampling  rate  begets  effects  similar  to  a  randomly  varying  time  delay 
(Ref.  53),  which  ie,  in  turn,  a  major  likely  source  of  remnant  (Ref.  12). 
As  shown  in  Ref.  5^ ,  only  a  small  random  fluctuation  in  an  otherwise 
constant-rate  sampling  is  needed  to  modify  shaiply  peaked  output  spectra 
to  smooth  and  continuous  power  spectral  densities.  So,  although  we  shall 
use  a  constant-rate  zero-order  hold  sampling  system  as  the  basis  for  the 
differential  displacement  model,  it  must  be  understood  that  this  is  an 
oversimplified  idealization  and  that  a  random  variation  in  sampling  rate 
is  actually  present.  Besides  the  time-varying  sampling  rate,  the  main 
remnant  source  for  this  model  is,  again,  implicit  in  the  pulselike  nature 
of  the  output. 

Based  on  these  introductory  comments,  the  block  diagram  of  Fig.  23 
illustrates  a  constant-rate  sampled-data  system  suitable  for  approximate 
generation  of  first-order  low  frequency  lead.  Just  as  with  the  velocity¬ 
sensing  model,  the  neuromuscular  and  coordination  processes  are  over¬ 
simplified  to  a  pure  gain  and  time  delay.  The  transfer  function  of  this 
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In  the  frequency  domain  this  becomes 
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For  frequencies  less  than  shout  I /T,  the  describing  function  is  approxi¬ 
mately  [using  sinh2  x  =  (x  +  x^/3:  +  x^/^:  +  . .  .  )c  1  x2 ,  for  x  <  1 /2J . 

=  KI^2(jaJ)e~Ja)(TA+T),  off  <  1  (38) 


This  system  generates  low  frequency  lead  at  the  expense  of  an  additional 
increment  in  time  delay.  Thus  it  exhibits  behavior  qualitatively  com¬ 
patible  with  that  required  for  low  frequency  lead  generation. 

To  compute  the  appropriate  incremental  time  delay  for  Yc  =  Kc/s2  over 
and  above  that  for  the  Yc  =  Kq/s  situation  (for  which  td  =  1/3  sec),  we 
must  first  recognize  that  the  analog  pilot  for  Yc  =  Kc/s  will  be  that 
shown  in  Fig.  23  without  the  difference  computation  element.  The  analog 
pilot  transfer  function  for  the  Yc  =  Kc/s  case  is  then 
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or,  as  a  frequency  domain  describing  function  for  off  c-  1  , 


^  K  Te-jo>(TA+T/2) 
Lx 


oil’  <  I 


(4o) 


Comparison  of  Eqs.  and  40  indicates  that  the  difference  in  effective 
time  delay  between  the  Yc  =  Kc,/s  and  Yc  =  Kc/s^  analog  pilots  is  just 
T/2  sec.  As  already  observed  from  the  traces  in  Figs.  11-13,  the  mini¬ 
mum  increment  of  the  flat  horizontal  discrete  portions  of  the  output 

traces  is  a*.,  - l/3  sec.  Using  this  as  the  estimate  for  the 

sampling  period,  T,  then  the  incremental  time  delay  associated  with  the 
generation  of  low  frequency  lead  will  be  approximately  1/6  sec.  This 
compares  extremely  well  with  the  difference  previously  noted  in  Subsec¬ 
tion  A  on  data  to  be  explained. 

A  major  possible  deficiency  with  this  model,  is  its  generation  of 
Gausric.n  output  amplitude  distributions  when  the  input  is  Gaussian.  Thus 
the  output  amplitude  distributions  will  not  be  of  the  bimodal  form  typi¬ 
fied  by  Fig.  14.  On  the  other  hand,  the  amplitude  distributions  of  the 
output  time  responses  for  the  Fig.  13  subject  are  probably  not  bimodal. 
There  are  gross  variations  in  style  from  subject  to  subject,  as  exempli¬ 
fied  by  comparison  of  Figs.  13  and  15,  which  will  be  reflected  in  the 
amplitude  distributions. 
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MODI  IS  TOR  TRAH0H3TT  CiPUTfl 

A.  imODUCTIOK 

The  simplest  nonstationary  control  situation  is  one  in  which  a  highly 
trained,  but  nonalerted,  subject  operating  a  constant-coefficient  linear 
controlled  element  in  a  compensatory  system  is  confronted  with  a  randomly 
occurring  step  input-  In  spite  of  the  simple  circumstances,  the  over-all 
behavior  is  complicated  when  a  variety  of  controlled  elements  is  considered. 
The  skilled  operator's  output  is  peculiar  to  each  controlled  element  form. 

The  system  response  is,  however,  less  variant  in  that  it  tends  to  duplicate, 
after  a  time  delay,  the  forcing  function.  Thus,  the  system  output  to  a  unit 
step  forcing  function  shown  in  Fig.  2b  is  typical  This  operator  response 
can  be  analyzed  by  considering  the  three  phases  separately.  When  described 
in  terms  of  a  block  diagram  which  relates  stimulus  to  response,  each  temporal 
phase  can  be  conceived  of  as  having  a  different  system  organization.  The 
block  diagram  structure  indicates  the  dynamics  of  the  association  between  the 
pilot's  response  and  the  actual  or  effective  inputs  which  he  is  operating  on 
to  generate  that  response  • 


Figure  ?b  .  Typical  System  Step  Response 

For  tracking  random  inputs  with  occasional  step  Inputs,  a  dual-mode 
model  of  the  operator  is  appropriate.  The  basxc  structure  of  the  model 
is  given  in  Fig.  2^.  The  quaBi-linear  steady-state  path  is  the  one  used 
for  tracking  random  inputs,  while  the  feedforward  element  operates  on  the 


Figure  25.  Structure  of  the  Dual-Mode  Model 

random- occurring  step  inputs.  The  basic  structure  also  incorporates  mode 
switches  for  the  two  pathways.  In  terms  of  the  three  temporal  phases  the 
successive  action  structures  of  the  dual-mode  model  are: 

•  Transition  from  quasi-linear  mode  to  feedforward  mode, 
corresponding  to  the  time  delay  phase 

•  Patterned  feedforward  response,  corresponding  to  the  rapid 
response  phase 

•  Quasi -linear  mode,  corresponding  to  the  error  reduction 
phase 

The  duration  of  the  time  delay  phase  has  some  minimum  value,  and  its 
unimodal  distribution  is  skewed  to  the  right.  The  time  delay,  ts,  is  gen¬ 
erally  longer  than  the  steady- state  effective  time  delay,  xe,  in  tracking. 
In  particular, 

TS  =  Te  +  Td  (41  ) 

where  ts  is  the  time  delay  phase  duration,  xe  is  the  effective  time  delay 
in  steady-state  tracking,  and  xd  is  the  decision  time.  During  the  deci¬ 
sion  time  the  operator  makes  the  pertinent  decisions  regarding  the  shape 
and  magnitudes  of  the  feedforward  response.  At  the  end  of  the  time  delay 
phase  the  feedforward  element  generates  the  proper  response  to  the  step 
input  command,  giving  the  rapid  response  phase.  At  the  end  ol  this  period, 
the  error  is  srru-ll  and  the  operator  switches  to  a  quasi-linear  tracking 
mode  in  the  error  reduction  phase. 
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Much  In  known  about  I  Im  quant  *  linear  com  ml  l«»ri  Uiarwf  ore ,  attention 
in  the  foil  iwlng  in  confin'd  to  t  h*>  pumllwl  IVpdfopwmM  i*th  m  llli'ml  In 
rmtponae  f.«  step  luput.n.  A«  a  ntartlng  point,  Hit  wulntlng  tmMwl  foi  ulep 
ituipone**  hahnvior  J«  reviewed. 

1.  CCSAJPT  IAX?LID*DAtA  ft  ’  IWOTXOR  TMMm  NOOU 


,‘itfVr'm  1  at tempt a  Itave  beet!  tttidt?  to  model  operator  ntep  response  hehavto 
The  moot  modern  and  complete  model  in  preeetited  in  Hef .  •• Thin  model 
proponed  «  samp  led -data  element,  i'or  the  fpodforww  i\t ,  An  ndnptat  ion,  for 
Htep  behavior  only,  I.  , ‘shown  In  Fig*  ■'*>  and  t  hr  .>iunp  led*  data  pot!. ion 
aiono  in  given  in  Fig.  Note  Mint  the  model  l«  «  hybrid  of  Yuiuig’H 

rye-movement  model  (Ref.  ' ■' •)  and  u  haiid-tmoking  model  by  ImMay  end 
Wectcott,  (Ref.  *■!>),  It.  borrow*  the  t.wo-aimnnel  pursuit /saccadic  control 
logic  of  the  eye-movoment  model  and  the  velocity  trlangl •  force  v  egmm  of 
the  hand -movement  model.  The  model  aleo  Incorporates  a  dual-rate  sampler 
that  provides  a  high  sampling  rate  while  waiting,  to  account  for  reaction 
time  delays,  then  slows  down  after  the  input  ie  annaed  to  i>ermlt  the  system 
to  complete  its  response  before  the  next,  sample  in  taken.  Finally,  Ine 
model  ia  extended  to  account  .or  higher  order  controlled  a  .lenient- a  via  the 
equalization  block  shown  at  the  end  of  a  long  train. 

The  sampler  ia  an  impulse  modulator  which  has  a  sampling  period  of 
0.1^  sec.  while  waiting,  ana  switches  to  a  sampling  period  of  0.1  see 
when  the  step  ia  detected.  The  sampled  pulae  1b  delayed  0 • 1 ' ■  sec,  tuid 
then  goes  into  the  force  programmer.  The  force  prog  ran  liar  an  ."-domain 


representation  obtained  by  letting  ?. 


.  i  .e.  , 


2e-(TA)8  +  fc-(T/?>B 


T  -  0.  t  see 


Notice  that  at  the  start  i .  =  e  since  initially  m=0.  Thi.;  prouuee."  the  »eri« 
of  pulses,  ci£,  shown  in  Fig.  I’M,  when  the  first,  pulse  In  e*  arrives.  The 
force  program  pulses  produced  by  subsequent  samples  of  the  error  are  shown 
dashed.  The  total  feedforward  output,  a,,,  is  determined  by  the  hold  and 
the  equalization,  which  ai'e  in  turn  a  function  of  the  cl  >sod-lo<>p  effective 
neuromuscular  system  dynamics  and  the  controlled  element,  order.  The 
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Figure  ;\M.  Force  Program  Response  t.o  Stap  Error 

equal Uat i on  contain, i  high  frequency  lags  that  are  not  shown  for  simplicity, 
It,  Is  shown  earlier  In  the  report,  that  the  pilot  output -to«ac  transfer  func 
tlon  ( t  > e  >  *  the  neuromuscular  system  dynamics)  Is  approximately  gi  ven  by 
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For  a  sampling  period  of  0.3  ®«c  In  the  sampler,  the  effective  neuromuscular 
eyat *m  dynamics  have  a  transfer  function  of  the  form  K/V-  to  a  first 
approx Imat ion j  that  is, 


where  Ka  ■ 


Tm,Tm8 


The  Ref.  ">6  force  prograamer  model  is  adequate  only  for  pure  gain  controlled 
elements  and  works  best  for  step  inputs  only.  ElAind,  Kelly,  and  Payne  in 
attempting  to  incorporate  the  force  program  concept  of  LeMay  and  Westcott 
into  the  Ref.  42  model  make  the  further  assumption  that  the  time  to  com¬ 
plete  the  force  program  remains  the  Bame  for  various  controlled  element 
dynamics  in  addition  to  Yc  ■  Ki> •  To  ■■  isfy  this  assumption,  we  allow,  as 
they  do,  for  an  equalization  of  the  form  (as5  +  be2  +  cs  +  d),  as  shown  in 
Fig.  27,  whose  coefficients  are  then  adjusted  to  give  an  effective  (m/a£) 


imnmrvr  function: 


-nj(n)  '  ”  (n«-  bu2  *  on  +  d)^j|Y0(»)J 

JL  ^  ^ 

'  ^ 

This  will  (i reduce  n  u«ri*>«  of  control  actions  by  operating  or  a£  which 
will  accomplish  the  rise  time  plinoe  stick  deflection  in  one  sampling 
Interval.  The  actual  signals  predicted  by  the  model  of  Figs.  '(.<  and 
are  summarized  in  Fig.  ,'\i  for  various  controlled  elements.  The  required 
equalization  coefficients  to  arrive  at  Eq>  are  summar l zed  In  Table  VI. I « 


TAME  VII 

REQUIRED  EQUALIZATION 


CONTROLLED  ELEMENT,  Yc 

EQUALIZATION  COEFFICIENTS 

Kc  . 

d  /  0  ,  a  ■  b  1-  c  ■  0 

Kc/s  . 

c  /  0  ,  a  «  b  -  d  =  0 

Kc/32  . 

b^O  ,  a  =  c  *  d  «  0 

Kc/s3  . 

a  /  0  ,  b  =  c*d  =  0 

It  is  clear  from  Fig.  29  that  the  step  response  is  completed  by 
t  -  0.45  sec,  when  the  next  sample  of  the  error  1b  taken  by  the  impulse 
modulator.  Thus,  the  error  is  zero  and  the  sampled-data  feedforward 
returns  to  a  waiting  status.  Note  that  the  stick  deflection  curves 
(c)  of  Fig.  29  bring  forth  the  principal  assumption  of  this  model  that 
the  time  to  complete  the  force  program  is  the  same  for  all  Yc,  resulting 
in  the  various  peculiar  shapes  for  the  stick  deflections.  However,  when 
Yc =  Kc  this  model  produces  a  bang-bang  ae  signal  to  the  neuromuscular 
system  which  correlates  with  the  successive  firing  of  the  agonist  and 
antagonist  muscles  to  accomplish  a  rapid  ballistic-like  hand  motion* 

The  above  relationship  does  not  hold  for  controlled  elements  o.f  a  higher 
order,  and  hence  the  merit  of  the  analogy  is  rather  limited. 


63 


Having  explained  the  ex  lilting  sampled -data  model,  lit:  salient  featur 
are  sum  ,rli*.ed  in  Table  VI 11  •  Note  that  the  delay  time  distribution  of 
the  proposed  sampled- data  model  is  rectangular  and  uniformly  distributed 
between  o .  1  •  •  and  o  •  3o  sec,  In  contrast  v i t h  past  data  which  indicate  a 
near-Gauss i an  distrlbutl on  of  the  inverse  time  delay-  This  is  the  major 
piece  of  existing  evidence  that  the  model  presented  above  did  not  explai 
at  the  time  of  its  genesis. 


TABLE  VIII 

SUMMARY  OF  MODEL  PREDICTIONS 


CONTROLLED 

ELEMENT 

Yc 

TIME  TO 
COMPLETE 
FORCE 
PROGRAM 
(STICK) 

SHAPE  OF  STICK  DEFLECTION  RESPONSE 

Kc 

0-13  sec 

/  ,  Second-order  .response 

J  '  to  step 

-•H  H-.lSwe 

Kc/s 

0*13  sec 

^  :  Triangle 

Kc/*2 

0-13  sec 

J~|j.  :  Double  pulse 

Kc/s3 

0-1  3  sec 

:  Impulse  train 

C  •  NEW  EXPERIMENTAL  DATA  AND  CONCLUSIONS 

With  the  intent  to  confirm  or  modify  the  hypothesized  sampled-data 
model  of  Figs.  2b  and  27,  step  response  data  for  various  controlled 
elements  and  differing  magnitude  step  inputs  were  obtained.  Sample 
step  responses  for  Yc  -Kc,  Kc/s.«  Kc./s'->  and  Kc/s"'  are  presented  in 
Fig.  30a,  b,  c,  and  d,  respectively.  For  each  controlled  element  the 
value  of  the  gain,  Kc,  was  picked  on  tie  basis  of  best  pilot  opinion 
rating  for  the  overall  system. 

The  important  step  response  parameters  are  obtained  by  averaging 
data  extracted  from  several  runs;  these  are  tabulated  in  Table  IX.  The 
comments  regarding  shape  and  nature  of  the  control  are  given  in  the  last 


Figure  50.  Sample  Step  Response  Data 
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column  of  Table  IX  and  are  discussed  later  in  the  section.  However, 
certain  basic  differences  between  the  hypothesized  sampled-data  model 
and  experimental  results  become  apparent  on  inspecting  Tables  VIII  and 
IX  and  the  sample  step  responses  of  Fig.  JO*  These  differences  are 
presented  in  Table  X  for  ease  of  comparison. 

In  the  light  of  the  new  data,  the  principal  error  in  the  hypothesized 
model  is  seen  to  be  the  assumption  that  the  time  to  complete  the  force 
program  is  a  constant  for  all  Yc*  Unfortunately,  this  is  a  key  assumption, 
and  its  discard  implies  that  the  hypothesized  sampled-data  model  is 
inappropriate  for  controlled  elements  other  than  pure  gain. 

D.  A  NEW  DUAL-MODE  CONTROLLER  MODEL 

An  important  aspect  obvious  from  the  step  response  data  is  the  bang- 
bang  nature  of  the  stick,  deflection  control  movements.  This  property  leads 
us  to  the  pertinent  problem  of  optimality  of  the  operator  and  his  related 
performance  indices,  one  explanation  is  that  the  operator  is  optimal  or 
suboptimal  relative  to  the  minimum  time  criterion.  Consider  an  nth  order 
single  input-single  output  control  system  with  |c(t)|  <  M,  where  the  scalar 
M  may  represent  either  a  physical  limit  on  the  stick,  deflection  or  more 
likely  an  implicit  restraint  imposed  by  the  operator  for  the  given  situa¬ 
tion.  In  any  case,  it  represents  a  magnitude  constant  or.  the  control 
input.  For  i(t)  •-  constant,  the  time  optimal  control  has  the  following 
properties : 

•  The  control  c(t)  is  bang-bang,  i.e.,  c(t)  *  or  -M. 

•  There  are  at  most  (n  — 1)  switchings  (i.e.,  ^  to  -H  or 
vice  versa)  for  systems  with  n  real  eigenvalues . 

•  The  switching  logic  is  dependent  on  the  order  of  the 
controlled  element.  In  general,  the  switching  surface 
is  a  nonlinear  function  of  the  state  variables. 

•  For  a  given  initial  condition  of  the  state  variables, 
there  is  one  unique  control  c(t). 

For  the  problem  at  hand,  there  is  a  specific  type  of  initial  condition 

of  the  system  state  vector,  namely: 

e(o)  =  input  height 
e(0)  -  0 

e(0)  -  0 


The  terminal  state  is  the  origin. 


TABLE  X 


HYPOTHESIZED  MODEL  PREDICTIONS  VERSUS  EXPERIMENTAL  RESULTS 


MODEL  PREDICTIONS 

EXPERIMENTAL  RESULTS 

1  .  Dele 

Model  predicts  a  uniform 

distribution  for  the  delay  time 

between  0.15  sec  and  0.30  sec 

for  all  Yc. 

Ly  Time 

Data  indicate  a  different 

mean  delay  time,,  for  each  Yc, 

with  low  variance. 

2.  Time  to  Complete  Force  Program 


Model  predicts  a  constant 

Data  show  that  the  time  to 

time  of  0.15  sec,  for  all  Yc,  to 

complete  the  force  program 

complete  the  force  program. 

increases  monotonically  with  the 

order  of  Yc . 

3-  Shape  of  Stick  Deflection 


a.  Step  change  for  Yc  =  Kc. 


The  stick  deflection  is  pul¬ 
satile  : 

a.  Step  change  for  Yr.  Kc* 


b.  Triangular  pulse  for 
Yc  =  Kc/s. 


b.  Rectangular  pulse  for 
Yc  =  Kc/ s • 


c.  Double  rectangular  pulse 
(plus-minus)  of  equal 
amplitude  and  pulse  width 
for  Yc  =  Kc/s2. 

c.  Same  as  for  model. 

d.  Train  of  three  impulses 

d.  Three  pulses  of  alternat¬ 

(plus- minus -plus)  for 

ing  signs.  The  width  of 

Yc  -  Kc/V'. 

the  middle  pulse  is 
aj  i  roxinw  tely  twice  that 
of  the  first  and  thi  I'd 

Etc . 

,  ilse- .  Pulse  amplitude 
is  approximately  constant 
for  iti roe  pulses. 

In  order  to  measure  the  degree  to  which  the  available  step  response 
with  c(t)  =  'M  data  is  time -optimal.,  certain  invarierce  conditions,  one 
for  each  controlled  element,  are  obtained  by  solving  a  two-point  boundary 
value  problem.  These  are  stated  and  described  in  Table  XI  without 
presenting  their  derivation;  thus,  let 

Tc  =  time  to  complete  the  force  response  (i.e.,  duration 
of  the  stick  response  correction  for  step  inputs) 

M  =  average  absolute  amplitude  (for  each  Yc)  of  the  stick 
response  assuming  it  to  oe  bang-bang  with  equal, 
positive  and  negative  amplitudes 

A  =  input  height 
Kc  =  controlled  elemert,  gain 
(  *)0  =  time  optimal  value  of  the  parameter  in  parenthesis 

The  conditions  are: 

TABLE  XI 

INVARIANCE  CONDITIONS  FOR  TIME  OPTIMALITY 
CONTROLLED  ELEMENT,  Yc 

*c  . 

Kc/s  . 

Kc/s2  . 

Kc/s5 . 

Assuming  a  wide  band  neuromuscular  system  response,  the  ideal  time-optimal 
step  response  character  for  differing  controlled  elements  is  shown  in 
Fig.  31 •  Note  that  the  smoothing  effect  of  the  neuromuscular  system  would 
round  off  the  corners  in  the  Fig.  31  responses  yielding  results  similar  to 
that  in  Fig.  30.  Ncte  further  that  the  control  movement  starts  after  the 
end  of  the  delay  time  phase,  and  time  optimality  pertains  to  that  period 
of  control  only.  Finally,  in  Table  XII  we  present  a  comparison  of  the 
actual  data  to  the  optimal. 

On  the  basis  of  the  comparisons  in  Table  XII,  it  may  be  safely 
concluded  that  the  step  response  behavior  of  operators  is  nearly 


INVARIANCE  CONDITION 
FOR  TIME  OPTIMALITY 

•  A/Kc 
(TeM)0  =  A/Kc 
(TcM1/2)d  =  PfA/Kc)1/2 

(TcM1/5)q  =  (32A/KC)1/5 


Figure  5< •  Ideal  Time-Optimal  Response  Charaeterist 
=  Time  to  Complete  Force  Program) 


TABLE  XII 


TIME-OPTIMAL  CONTROL  CHARACTERISTICS  FOR  STEP  INPUTS; 
COMPARISON  WITH  EXPERIMENTAL  RESULTS 


INDEX  FOR  TIME  OPTIMALITY 

DECREE 
OF  TIME 
OPTI¬ 
MALITY* 

Invariance 

Condition 

Optimal 

Expt . 

Kc 

o3  & 
o  o 

II  II 

° 

Kc  =  2.86 

A 

■3MM 

HE3N 

10 

20 

1 

| 

0.4 

0.5 

0.36 

0.40 

Kc/e 

(T=M)o  “  £ 

i 

Kc  =  7-1 

A 

(TcM)o 

1 

8.34 

8.10 

11  .45 

6/7 

8/7 

10/7 

0.120 

0.1  6l 

0.201 

______ _  _  1 

0.1 30 

0.146 

0.178 

I 

Kc/s2 

! 

(TcM'^a^y72 

Kc  =  14.J 

A 

Mhaw 

(TcM1  /2)e 

0.4l 

0.71 

11  .8 

6/7 

8/7 

10/7 

0.490 

0.564 

0.632 

0.488 

O.568 

0.707 

£ 

cn 

Kc  =  3-6 

A 

kpbSH 

(T0Ml/3)e 

6 

3 

8/7 

10/7 

2.17 

2.33 

2.04 

2.40 

*  1 1 
Percent  error  =  ■ 

Optimal  -  experimental!  y 

**(*)e 


value  of  the  parameter  in  parenthesis 
from  experimental  data 


time -optimal.  Variations  in  the  switching  logic  appearing  in  actual  data 
dc  not  affect  the  terminal  zero  error  condition  substantially ,  but  do 
affect  terminal  error  rate  and  acceleration.  Perhaps  the  operator 
strategy  is  to  reduce  e,  e,  . • • ,  e^  ^  to  small  values  rather  than 
to  try  and  make  these  exactly  zero.  The  operator  resorts  to  auasi-linear 
steady- state  control  behavior  once  the  error  phase  trajectory  enters  the 
region  near  the  zero  state.  Another  explanation  for  the  suboptimal  con¬ 
trol  may  be  that  the  operator  trades  off  time  optimality  to  minimize  some 
other  secondary  performance  index.  It  is  also  worth  noting  from  Table  IX 
that  the  stick  amplitudes  and  pulse  durations  for  different  controlled 
elements  seem  to  be  roughly  the  same.  This  may  be  the  reason  for  selecting 
the  particular  controlled  element  gains  on  a  "best''  pilot  opinion  rating 
basis . 

E.  SUMMARY 

In  conclusion,  a  time-optimal  control  model  is  one  possible  idealization 
for  the  feedforward  step  response  path  of  the  dual-mode,  mode-switching 
model  for  the  operator-  The  complete  model  is  presented  in  Fig-  32,  as 
one  explanation  of  available  data.  The  quasi-linear  path  is  the  usual 
operator  describing  function  for  compensatory  steady-state  tracking  of 
random  inputs.  The  feedforward  parallel  path  represents  the  control  plus, 
decision  model  of  the  operator  in  response  to  step  inputs.  The  nonlinear 
error  sensing  blocks  in  Fig.  32  automatically  route  the  error  signal 
through  the  appropriate  channel  based  upon  whether  e  ^  erp  (e^  is  some 
threshold  magnitude  of  error) . 

The  control  logic  for  each  different  controlled  element  and  as  a 
function  of  the  error  state  e  [e  = col  (e,  e,  -••)]  is  given  in  Table  XIII 
for  time-optimal  response.  Note  that  M,  the  constraint  on  the  control 
input,  is  some  function  of  the  step  input  height,  controlled  element 
gain,  and  its  order. 

The  decision  logic  model  behaves  like  a  function  switch  (FSW)  and 
accounts  for  the  initial  increase  in  the  time  delay  (beyond  that  due 
to  quasi -linear  tracking)  in  response  to  a  step  input.  The  neuromuscular 
command  used  by  the  operator  seems  to  be  7C  input  rather  than  ac • 


t  =  Structural  time- detoy  of  the  operator 
eT=  Error  -  threshold 


TABUS  X.1 11 


CONTROL  LOGIC  FOR  VARIOUS  CONTROLLED  ELEMENTS 


CONTROLLED  ELEMENT 
Yo 

CONTROL  IOGTC 

r(£) 

Kc  . 

(A,/MKc)«(t) 

Kc/a  . 

Kc/s'"  •••*•••••« 

Kc/a3  . 

e(t) 

[e  +  y'a-lKcluJ  sgn  e  j 
je  +  (1/J)e5  +  Wee  +  wj(l/.?)e‘2 

W  *•  +1  for 

e  +  (l/2)e|e| 

>  0 

*■  -1  for 

e  +  (l/2)e|e| 

<  0 

(Ref-  37) 

The  model  of  Fig.  3C  should  thus  serve  as  one  possible  explanation 
of  operator  behavior  in  response  to  random  plus  step  inputs. 

I".  00HCLUBI0H8 

The  proposed  model  is  a  first  step  towards  evolving  composite 
operator  models,  good  for  both  random  and  transient  inputs.  Indeed, 
it  is  an  idealization;  so  with  this  in  mind,  future  experiments  mxnt 
be  directed  to  verifying  its  optimality  and  sensitivity.  Other  perfor¬ 
mance  indices  may  be  tried  to  see  if  the  given  system  is  relatively 
optimal  with  regard  to  them.  This  way,  one  may  be  able  to  show  that 
operator  control  is  perhaps  not  so  sensitive  to  variations  in  performance 
criteria . 
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MOTION  VI 


xxxsaixx}  th  auooMtrvx  organization  of  mormon  or  euman  operators 

A.  THE  SUCODMIVI  ORGANIZATION  OF  PERCEPTION  THEORY 

The  human  attributes  of  multimodal  sensory  perception,  multimode 
output  behavior,  and  judgment  and  adaptability  to  the  received  inputs, 
outputs,  and  error  lead  to  an  enormous  number  of  possible  control  loop 
structures  for  any  given  situation.  Through  higher  order  processes,  such 
as  Judgment  and  memory,  the  pilot  can  evolve  and  modify  hiB  performance 
criteria,  select  relevant  inputs,  decide  between  competing  control  loop 
structures,  and  optimize  his  fine-grained  behavior  with  respect  to  several 
criteria.  To  cope  with  this  kaleidoscope  of  possibilities,  the  theory  of 
Successive  Organization  of  Perception  (SOP)  was  evolved  (Ref.  rj&)  .  This 
theory  postulates  possible  interpretations  and  organizations  of  the  input 
data,  and  the  establishment  of  the  appropriate  internal  system  organiza¬ 
tions  so  that  the  information  may  be  exploited  for  effective  control. 

On  the  one  hand,  SOP  theory  can  be  viewed  as  explaining  the  vai'ious 
modes  of  human  pilot  behavior  observed  in  particular  situations.  On  the 
other,  this  theory  can  serve  as  a  tool  for  the  pilot/vehicle  system  analyst 
by  providing  the  set  of  rules  for  selecting  the  mathematical  pilot  model 
appropriate  to  a  particular  situation.  This  latter  use  of  the  theory'  is 
that  which  concerns  us  here. 

The  necessity  for  SOP  theory  in  the  model  selection  sense  is  only 
now  beginning  to  develop.  However,  as  human  pilot  behavior  becomes  better 
understood,  and  hence  more  behavioral  modes  become  amenable  to  mathematical 
modeling,  rules  for  model  selection  will  assume  much  greater  importance  than 
they  do  at  present.  Current  rules  for  model  selection  are  almost  entirely 
qualitative.  Because  the  over-all  family  of  pilot  models  may  be  expected 
to  grow  substantially  in  both  numbers  and  complexity,  the  eventual  necessity 
of  an  orderly  quantitative  model  selection  scheme  would  seem  to  be  necessary 
for  routine  application  of  these  pilot  models. 
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It  appears,  however,  that  an  all-out  effort  to  develop  such  a  quanti¬ 
tative  model  selection  scheme  would  be  premature  at  this  time.  What  does, 
at  present,  seem  warranted  is  a  summary  of  the  techniques  which  might  be 
used  to  formulate  the  selection  scheme,  and  the  development  of  some  exem¬ 
plary  application  of  the  technique.  The  purpose  would  be  to  provide  a 
framewoi’k  to  encourage  development  of  quantitative  criteria  for  model 
selection.  A  very  limited  number  of  existing  quantitative  criteria  (for 
the  most  part  pertaining  to  the  quaei-linear  pilot  describing  function  for 
use  in  the  visual  modality,  single-loop  compensatory  tracking  of  a  narrow 
band  random  input  situation)  could  be  fitted  to  this  framework  now.  To 
approach  the  ultimate  goal  of  an  "automatic"  selection  scheme  more  closely 
than  indicated  above,  for  example,  by  constructing  a  detailed  decision 
process  algorithm,  is  Just  not  consistent  with  the  present  state-of-the- 
art  in  either  human  pilot  modeling  or  SOP  theory. 

The  question  thus  arises,  "Should  we  attempt  to  construct  an  interim 
set  of  model  selection  rules  which  will  be  only  partly  quantitative?"  The 
answer  seems  to  be  "yes"  for  at  least  two  reasons.  First,  an  interim  effo: 
will  provide  a  well-organized  procedure  which  will  assure  that  a  reasonabl; 
complete,  albeit  largely  subjective,  set  of  criteria  is  considered  in 
selecting  appropriate  pilot  models  for  pilot/vehicle  analysis.  This  organ 
ized  procedure  would  eliminate  some  of  the  artistic  flavor  presently  assoc: 
ated  with  the  model  selection  process  in  the  mind  of  the  working  engineer. 
The  second  reason  recommending  an  interim  effort  arises  from  the  detailed 
complexities  that  will  accompany  the  programming  of  the  ultimate  "automatii 
selection  scheme.  The  complexities  are  precisely  those  of  exposing  the 
logical  decision  processes  used  by  the  knowledgeable  human  analyst  in 
selecting  a  model.  The  success  of  the  programming  depends  on  being  able  ti 
"ask  the  right  questions."  That  is,  to  formulate  a  set  of  hypotheses  as  tc 
how  the  analyst  selects  the  model.  It  does  not  matter  that  some  hypothesis 
may  be  incorrect,  since  there  are  techniques  of  varying  sophistication  for 
eliminating  incorrect  hypotheses  (see,  for  example.  Ref.  59)*  What  is 
important  is  that  the  set  of  hypotheses  includes  as  a  subset  the  "correct" 
hypothesis.  It  appears  that  the  only  way  hypotheses  may  be  introduced  is 
by  external  statement.  Here  the  experience  of  the  human  analyst  plays  an 
important  role.  It  is  important  that  the  stated  hypotheses  be  the  result 
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OI  informed  judgment  and  not  pure  guesses  for  efficiency  in  hypothesis 
testing. 


In  the  following  we  shall  review  the  highlights  of  SOP  theory,  and 
then  proceed  to  speculate  on  models  which  imitate  the  SOP  process  itself. 
These  models  will  be  suggestive  of  a  sequential  decision  process. 

The  essential  stages  in  the  SOP  learning  sequence  are  shown  in  Fig.  33, 
and  are  described  below  (after  Ref.  58): 


Ccapensatory  (Fig.  33a). 
only  to  the  error  (input 
sented  by  Ype. 


The  pilot  is  given,  or  pays  attention, 
minus  output)  characteristics  repre- 


Purtuit  (Fig.  33b).  The  pilot  perceives  both  the  input  and  out¬ 
put  (and,  hence,  error).  'He  uses  any  predictable  aspects  of  the 
input  (represented  by  YPi),  as  well  as  the  learned  characteris¬ 
tics  of  his  proprioceptive  sense  of  control  motions,  Yp^,  and  the 
controlled  element,  Ypm,  to  operate  in  some  "optimum"  miiner  on 

the  input  with  a  compensatory  vernier  correction  operation  on  the 
residual  errors,  Ype. 

Preeopiltlve  (Fig.  33c).  The  pilot  perceives  the  input  and 
recognizes  (or  chooses)  a  perfectly  predictable  pattern.  His 
selected  response  is  subsequently  preprogrammed  or  open- loop 
for  large  intervals  of  time. 


The  block  diagrams  of  Fig.  33  are  suitable  to  represent  not  only  the  pilot's 
progression  to,  or  regression  from,  higher  levels  of  internal  system  organ¬ 
ization  in  a  given  situation,  but  also  grossly  represent  the  possible 
loop  structures  when  different  levels  of  display  information  are  provided. 

For  example,  in  early  stages  of  training  a  pilot  will  operate  minly 
on  the  perceived  error  (i.e.,  in  a  dominantly  compensatory  nanner)  even 
if  the  output  and  input  are  both  displayed,  as  in  a  pursuit-type  instru¬ 
ment.  Conversely,  even  with  a  compensatory  display  (error  only),  if  the 
input  has  a  definite  pattern,  leading  to  a  corresponding  pattern  in  his 
required  control  actions  which  he  can  perceive,  perhaps  only  subconsciously, 
then  he  can  structure  a  loop  based  on  this  proprioceptively  sensed  control 
action  to  provide  a  self-generated  "input,"  ip,  to  generate  most  of  the 
required  control  movement.  This  progression  to  an  internally  organized 
pursuit  mode,  given  a  pure  condense tory  display,  is  represented  in 
Fig.  33b  by  switching  to  ip  via  the  Ypp  loop.  After  much  training,  the 
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Human  Controlled 


a i  Initial  Phast  ;  COMPENSATORY  (Sing*  Loop) 


b)  Second  T  'fast  :  PURSUIT  (Multiloopl 


I - 1 


Figure-  V .  Tin/  Three  Mm  in  Phnr.es 
in  the  Successive  Orgnni  ::nti  c  n  of  p.-r  “.*!>♦  if.i.  'pop' 


pilot  can  even  close  his  eyes,  thus  opening  the  YPe  loop  and  operating 
solely  on  his  learned  response  pattern.  Thus,  given  some  pattern,  or 
"coherence,"  to  the  input,  he  can  actually  progress  to  the  precognitive 
mode  for  short  intervals  with  only  a  compensatory  display i  This  will  be 
illustrated  later,  but  the  key  point  is  that  the  Successive  Organization 
of  Perception  theory  describes  the  human  pilot's  construction,  via  internal 
organizational  changes,  of  a  succession  of  perceptual  inputs  which 

•  Are  equivalent  to  more  elaborate  displays  than  those  from 
which  the  stimuli  were  obtained 

•  Induce  background  or  references  not  physically  present 

•  Make  highly  efficient  use  of  any  coherence  in  the  presented 
stimuli 

The  SOP  theory  leads  to  an  understanding  of  both  the  progressive  and 
the  regressive  control  behavior  during  training,  transfer,  stress,  equip¬ 
ment  failures,  etc.,  and  it  offers  a  unifying  approach  to  the  display 
problem. 

Before  proceeding  it  is  appropriate  to  expand  upon  the  modeling  process. 
First,  there  are  two  general  types  of  mathematical  modeling  activity 
which  con  be  described  as: 

.  These  models  need  have  no  direct  structural 
but  are  intended  to  codify  measured  data 
more  efficiently  and  to  permit  prediction  within  the  explored 
ranges  of  variables.  Models  of  this  type  include  input/output 
catalogs,  statistical  regression  models,  statistical  detection 
avid  decision  models,  closed-loop  describing  function  measure¬ 
ments  and  dvta  fits.  They  have  the  advantage  of  simplicity, 
analytical  utility  and  efficiency,  and  known  confidence  limits. 

.  These  models  attempt  to  describe  the 

auee/effect  events  which  lead  to  the 
observed  input/output  data.  In  some  important  cases  these  can 
be  partially  derived  from  the  data  descriptor  models  (e.g., 
determining,  or  measuring,  human  operator  open- loop  describing 
functions  in  single-loop  compensatory  tracking  of  random  inputs), 
but  in  most  caBes  they  are  derived  from  heuristic  reasoning  in 
the  face  of  an  array  of  facts  to  be  "explained."  Analog  models, 
o.  "mimics,"  are  often  too  complex  or  nonlinear  to  measure  effi¬ 
cient!;.'  and  seldom  achieve  the  statistical  confidence  possible 
with  data  descriptor  models.  Nevertheless  they  are  ultimately 
desirable  to  rationalize  the  observed  over-all  behavior  or  to 
simulate  the  fine-grained  behavior. 


Btruotuiml  or  analog  aodals 

mechanization  or  internal  ci 


analog  in  the  process, 


A  blending  of  these  types  of  models  is  usually  achieved  in  human  pro¬ 
cess  modeling  when  a  theory  is  fitted  to  a  large  body  of  codified  data  and 
the  variations  are  accounted  for  by  recognizable  features  in  the  operator's 
physiology. 

B.  MSDSLS  IMITATING  THE  SOP  PROCESS 

The  Successive  Organization  of  Perception  process  has  been  described 
as  a  progression  through  three  main  phases  of  loop  organization,  each  con¬ 
taining  a  number  of  subsets  of  behavior  appropriate  to  the  task.  Assume 
that  identifiable  limits  and  conditions  can  be  found  (e.g.,  experimentally) 
for  each  subset  mode  of  observed  behavior.  Then  one  model  for  the  SOP 
process  would  be  an  active  off-line  monitor  which  identifies  the  conditions, 
selects  some  most  likely  mode,  monitors  the  result,  reselects  a  new  mode 
when  necessary  or  when  further  information  is  brought  out  by  the  first 
operations,  and  so  forth.  This  model  is  not  intended  to  be  an  analog  of 
the  mental  processes  involved,  but  is  merely  an  efficient  way  of  coding  and 
selecting  the  most  likely  mode  of  behavior  from  those  which  have  beer; 
distinctly  identified  and  modeled.  This  model  is,  among  other  things,  a 
description  of  an  analyses  procedure  in  which  estimates  of  behavior  mode 
are  the  key  outputs  desired. 

An  appropriate  form  for  this  model  is  a  flow  or  decision  process 
algorithm.  Such  models  have  been  described  in  Refs.  00  and  »>1  ,  and 
applied  to  a  specified  task  involving  a  given  sequence  of  subtasks  in 
Refs.  '/)  and  62  -  Ol  .  for  example,  Re  i  gel  and  Wolf  (Re!'.  )  utv  a 

sequential  state  model  with  probabilistic  state  transitions  ( ".sti muted 
by  direct  inquiry  of  squadron  commanders)  and  a  Monte-furlo  computer 
analysis  to  investigate  the  pxle-up  of  sequential  tasks  required  to 
effect  the  downwind  approach,  turns,  flap  and  landing  gear  preparation, 
and  flight  path  line-up  for  landing  on  an  aircraft  carrier.  Thoma:  and 
Tou  in  Refs.  '>•>  and  (V<  set  up  th»  selection  of  an  optimal  path  ir  ® 
point-to-point  by  dynamic  programming.  Braunsten,  «*t  al  (Ref.  t-  ,  gi  v* 
computer  algorithms  for  the  car- following  driver  task,  interpreted  us  an 
on-going  sequential  process,  and  they  attempt  some  statistical  measurements 
of  one  subroutine  parameter  required  by  highway  tests.  Thus,  this  approach 
is  by  no  means  novel,  and  there  are  several  current  programs  whieh  rhoui  j 


yield  material  useful  to  the  present  problem.  Most  of  these  attempts  have 
had  limited  success  because  of  the  inordinate  complexity  and  repetitive 
cycling  required  to  represent  continuous  tasks. 

The  suggestion  here  is  that  algorithm  models  may  be  much  more 
appropriate  and  successful  when  applied  to  the  SOP  sequence  itself  than 
to  describe  any  particular  mode  of  tracking.  This  is  because  most  of  the 
observed  manual  control  behavior  falls  into  relatively  few  categories 
from  which  logical  criteria  can  select  the  most  suitable,  e.g.,  the  three 
phases  of  SOP  in  Fig.  33*  Within  these  phases  of  SOP  various  submodes  are 
required,  but  many  of  these  already  have  well-modeled  characteristics. 

The  rather  heterogeneous  forms  and  degree  of  approximation  described  here 
and  elsewhere  are  ideally  called  up  by  mode-selection  algorithms.  Thus, 
the  algorithmic  models  are  used  where  they  are  beet  suited  (logical  func¬ 
tions),  while  the  continuous  servo  models  of  human  behavior  are  used  where 
they  are  most  efficient  (well-defined  tracking  or  stimulus  response 
situations) . 

Some  preliminary  work  on  an  algorithmic -type  model  for  the  SOP  process 
is  shown  in  Figs.  31*  ,  35,  and  36.  The  process  of  constructing  a  flow 
diagram  to  simulate  a  decision-making  or  learning  process  is  instructive 
in  itself  because  one  is  forced  to  formally  define  and  examine  the 
logical  structure  behind  decisions  which  are  often  nade  in  a  casual 
manner.  The  formalism  also  focuses  attention  on  categorizing  and  finding 
efficient  hierarchies  of  decision-making  criteria.  For  example,  the 
difficulty  of  constructing  Figs.  3J<  and  35  illustrates  why  some  investi¬ 
gators  have  had  a  hard  time  using  and  adapting  the  well-established 
qua si -linear  pilot  models  to  real-world  problems.  Even  for  these  models 
it  is  hard  to  specify  written  criteria  or  instructions  for  selection. 

Part  of  the  problem  lies  in  the  heterogeneity  of  the  types  of  models 
evolved,  and  part  lies  in  the  diverse  concepts  and  words  which  might  form 
suitable  categories  or  descriptors.  These  problems  are  connon  to  library 
search  routines,  and  some  library  document  retrieval  procedures  were 
adapted  to  simplify  the  concepts. 

Figure  '•*  chows  a  flow  diagram  for  some  key  steps  which  must  precede 
the  selection  of  a  particular  human  pilot  mode  of  behavior  and  thence 
the  aopropriate  model  and  adjustment  rules.  The  "situation”  ^election 
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Figure  Typical  Mode/Model  Catalog  and  Selection  Proces 


Given  mode  and  model,  call  up  instructions 


Figure  ?/>.  Typical  Subroutine  for  Compensatory  Mode 


U\  i  h*--  most  vaguely  denned  at  present .  It  in  eany  to  describe  nny  given 
ftlt*siU.»h  vedmlly,  but  not  to  categorise  It  in  compact  Tom.  Probably 
something  UK#  ten  to  twenty  suitably  different  descriptor*  would  cover 
nuy  reasonable  case  here,  nnd  only  five  to  ten  would  to  required  for  the 
majority  of  oases.  An  few  descriptor*  a*  possible  are  desired  to  avoid 
the  problem  of  dlmensionall ty ,  Once  the  situation  in  selected,  one  oan 
Ho  directly  to  specific  instruments  if  these  are  specified  (or  if  the 
pilot  la  already  in  a  given  loop,  in  a  transition  or  railure  mule  nitua- 
lion).  Otherwise,  possible  Inforaation  channel#  assigned  to  a  given 
ait  twit  ion  taunt  tie  scanned,  and  the  moat  likely  or  priority  itema  then 
selected.  flubrvjuune#  for  thin  step  are  more  apparent  ,  hut  t|»e  detail# 
fur  their  implementation  ai'e  difficult  to  describe  in  a  quantitative  manner. 
For  example ,  the  mult  i  loop  hypothesis  can  he  used,  and  heuristics  and 
•empirical  experience  might  he  used  to  evolve  a  rational  aeleotlon  procedure, 

Identification  of  the  type  of  display  la  at  might,  forward  if  it  la  an 
instrument  (single  or  integrated),  hut,  imy  be  more  difficult  for  the 
visual  field  situation. 

Determining  the  predictability ,  or  coherence,  of  the  information 
available  will  be  very  difficult  in  many  oases.  Strong  discrete  cues  or 
mnd um  Inputs  are  no  problem,  since  subjective  criteria  for  unpredicta¬ 
bility  are  not  too  tail'd  to  define.  But  to  recognise  subtle  cues,  complex 
periodic  waveforms,  etc.,  will  require  both  analytical  and  experimental 
data  not  yet  available. 

Assessment.  of  the  operator's  familiarity  with  the  task  and  instruments 
(i.e.,  skill  level)  is  an  important  factor  in  selecting  his  mod©  of  opera¬ 
tion.  This  criterion  must  bo  externally  prescribed,  and  will  not  be  tested 
for  dlrect.1/. 

finally,  all  these  preliminary  criteria  have  been  selected,  and  a  set 
of  descriptors  will  be  available  at  Exits  A,  C,  D,  l),  and  F  of  Fig.  • 

The  mode  and  model  can  then  be  selected.  Two  general  approaches  are 
possible  here: 

1.  A  logical  selection  ;ree,  from  which  the  correct  mode  is 
picked  by  climbing  along  a  sequence  of  branches,  guided  at 
each  brunch  node  by  one  of  the  (say,  n)  deaeriptore  previ- 


ouuiy  pvu l vo't  >  The  nniii  advntUAge  1°  ap*«d  in  going  d.l  red  Ly 
to  the  dnsirt'd  bmnoh  in  n  steps.  The  disadvantage  in  Unit 
there  in  an  enormous  number  of  terminal  brunches,  hut  only  a 
relatively  few  ite uimit  and  models  ig  select  from.  Hence,  the 
Name  item  appears  on  imny  branches,  and  the  storage  ant  logic 
coding  prooewu  in  cumbersome, 

A  cronu-filed  catalog  of  each  nvxle,  ae  it  haooawn  nvuilable, 
from  which  the  appropriate  m*idt»J  in  selected  »y  the  oonJune> 
t.ion  of  n  net  of  n  entry  descriptors  with  those  labeling  Uie 
mtxtcl.  The  advantage  is  ease  of  coding  and  storing  the  rela¬ 
tively  few  (say,  mj  m  >  n)  modes  and  descriptors,  and  the 
diwidvuntagea  are  the  slightly  longer  search  required  (if  a 
simple  sequential  search  la  vised)  and  the  fact  t.lvat  a  mode 
can  he  retrieved  only  for  sets  of  descriptors  assigned  to 
storage. 

Much  more  work  needs  to  he  done  on  tills,  including  use  of  combined  logical 
t  reys  and  descriptor  con,)  uictione.  At  present,  the  beat  nebeme  appears  to 
be  No.  above,  which  is  Illustrated  in  Fig.  JV  •  Note  that,  each  model  in 
Fig.  V  lias  n  large  number  of  descriptor  sets  associated  with  it.,  of 
which  only  a  couple  samples  of  each  are  shown.  Another  descriptor  net 
may  be  added  at  any  time  as  the  range  of  validity  of  a  model  is  extended, 
and  a  given  group  of  descriptors  and  modeln  may  be  taken  out,  refined, 
and  given  sejarate  identity  without  changing  the  remaining  items.  A 
great  deal  of  work  needs  to  be  done  in  simplifying  and  rationally  index¬ 
ing  the  descriptor  sets  to  facilitate  the  search.  Aloe  shown  on  the 
right  of  Fig.  are  descriptors  for  the  confidence  level  and  alternative 
items  to  search  in  case  the  likely  mode  does  not  work  out. 

Once  an  appropriate  mode  of  operation  and  model  have  been  selected, 
the  adaptation  rules  and  criteria  are  called  up  and  the  human  pilot  ’d 
behavior  is  suitably  simulated.  ThiB  adjustment  and  op t imaliratian 
process  is  shown  in  Fig.  jo.  Details  of  this  process  lave  been  discussed 
in  previous  sections. 

The  problem  haa  been  fairly  well  structured  at  this  point,  although 
refinements  will  continue  to  be  required.  The  next  most  pertinent  task 
Is  to  make  the  theory  opemtloral  l'or  a  few  simple  caBes,  This  will 
demonstrate  the  feasibility  of  the  approach,  and  the  interactions  with 
other  topics  (such  as  optinul  control  patterns)  discussed  in  this  report. 
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This  hoc  Mon  will  consider  the  physiological  problems  and  mechanisms 
involved  in  rnuwui  pilot  tracking  beliavior,  especially  those  concerned 
with  more  complex  functions  which  are  not  simply  accounted  for  at  the 
peripheral  neuromuscular  level.  The  recent  surge  of  research  devoted  to 
neuromuscular  mechanisms  hao  gone  a  long  way  toward  clarifying  the  prop¬ 
erties  of  the  peripheral  neuromuscular  command  and  control  apparatus,  and 
gives  us  helpful  and  suggestive  Insights  into  the  mechanisms  at  higher 
levels  of  the  nervous  system  which  play  upon  „he  peripheral  system. 
Although  physiological  research  methods  are  still  limited  to  the  investi¬ 
gation  of  quite  restricted  kinds  of  activity  in  restricted  situations, 
and  usually  involve  experimental  animals  rather  than  humans,  there  are, 
fortunately,  enough  examples  from  which  some  general  principles  of  system 
organization  can  be  derived;  by  appealing  to  these  through  analogy  and 
inference  we  will  attempt  here  to  provide  a  suitably  sound  basis  for  the 
models  of  human  pilot  behavior  discussed  elsewhere  in  this  report. 

This  section  is  subdivided  into  four  partB.  First,  a  review  of  the 
basic  peripheral  neuromuscular  control  apparatus  will  be  presented,  in 
which  the  mass  of  new  research  data  relevant  to  the  present  discussion 
will  be  summarized.  This  review  provides  some  of  the  physiological  back¬ 
ground  for  the  neuromuscular  system  model  summarised  in  Section  II,  and 
serves  as  a  point  of  departure  for  the  discussion  of  higher  centers 
involved  in  control.  Second,  a  summary  will  be  made  of  the  functional 
properties  of  some  higher  neuronal  centers  of  the  brain,  especially  in 
relation  to  their  modification  of,  and  interaction  with,  the  peripheral 
neuromuscular  system  described  in  the  firBt  part.  Third,  we  describe 
the  operation  of  two  subcortical  compensatory  motor  control  systems  whose 
organization  and  function  are  sufficiently  important  to  consider  their 
implications  for  models  of  skilled  motor  performance.  These  systems  have 
possible  direct  parallels  to  the  more  "automatic"  aspects  of  compensatory 
tracking  during  stationary  conditions  after  extensive  training.  The 
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fourth  section  brings  in  the  cerebral  centers  needed  for  logical,  learning, 
permissive,  etc.,  operations  required  before  any  skilled  "automatic" 
beliavior  is  possible. 

A.  HRXFIBttL  WUMMUBCUIAK  00WR0L  IZXMUfTS 

Ultimately,  all  the  complex  decision-making  and  command -gene rating 
centers  of  the  brain  must  make  use  of  the  basic  neuronal  circuits  operating 
at  the  spinal  level  together  with  the  special  sensory  organs  associated 
with  them  at  the  periphery.  As  a  result  of  an  enormous  research  effort 
over  the  past  ten  >ears  we  have  come  to  know  relatively  a  great  deal  about 
them  and  their  mode  of  action,  at  least  in  isolation.  The  behavior  of 
pure  spinal  systems  is  a  powerful  determinant  of  the  way  supraspinal  centers 
interact  with  them,  and  their  behavior  suggests  ways  in  which  we  interpret 
the  activity  we  are  able  to  observe  at  higher  levels. 

It  is  not  the  purpose  of  this  report  to  give  a  detailed  summary  of  the 
peripheral  neuromuscular  control  elements  and  systems;  for  this  the  reader 
is  referi-ed  to  several  recent  symposia  and  reviews  (Refs.  6r;-7l)  and  our 
own  model  of  this  system  (Ref.  28)  which  is  summarized  in  part  in  Section  II. 
In  what  follows  we  shall  merely  give  a  very  brief  account  of  some  of  the 
more  important  elements  and  their  properties  so  that  the  reader  may  be 
better  able  to  follow  later  discussions. 

Much  of  the  control  of  neuromuscular  behavior  in  the  periphery  is 
dependent  on  a  complex  organ  located  in  the  muscles  of  the  body,  the 
muscle  spindle .  It  is  In  itself  a  complex  neuromuscular  integrative 
system  receiving  a  continuous  set  of  motor  control  and  command  signals 
from  the  central  nervous  system,  and  sending  a  constant  stream  of  sensory 
information  signals  via  several  paths  back  to  the  central  nervous  system. 

A  typical  muscle  may  have  50  to  80  of  these  organs,  embedded  at  various 
points  among  the  tension-producing  ( "extrafusal")  muscle  fibers  of  the 
main  muscle  mess.  A  typical  spindle  is  elongated  in  shape,  may  be  several 
millimeters  in  length,  and  has  an  orientation  parallel  to  that,  of  the 
extrafusal  muscle  fibers.  They  may  be  arranged  in  isolation,  in  tandem 
with  each  other,  or  be  found  in  conjunction  with  other  specialized  receptor 
structures  of  the  muscle.  Each  spindle  has  a  centra, 1  axis  which  consists 


of  a  globular  nuclear  bag  region  (Fig.  37)  connected  to  either  pole  of 
the  spindle  by  means  of  a  pair  of  nuclear  bag  fibers,  which  are  them¬ 
selves  typical  striated  muscle  fibers  (~  25|am  in  diameter).  In  addition 
to  this  there  are  from  one  to  five  subsidiary  muscle  fibers,  the  chain 
fibers  (l0-15pm  in  diameter),  which  may  or  may  not  extend  the  entire 
length  of  the  spindle.  Thus,  although  the  two  fiber  systems  are  distinct, 
they  may  interact  by  virtue  of  their  mechanical  coupling.  The  nuclear 
bag  and  chain  fibers  are  known  collectively  as  "intrafusal  fibers,"  and 
are  never  observed  to  contribute  directly  to  the  development  of  tension 
in  the  muscle.  Rather,  they  appear  to  be  motor  fibers  related  solely  to 
control  within  the  spindle  itself.  From  their  microscopic  appearance  the 
bag  fibers  appear  to  be  normal  striated  muscle  fibers  and  hence  would  be 
expected  to  have  dynamic  and  mechanical  properties  similar  to  those  of  the 
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Figure  37-  Diagram  of  Muscle  Spindle 


Both  types  of  intrafusal  fibers  are  innervated  by  special  motor  axons 
arising  from  cells  in  the  spinal  cord.  The  axons  have  a  diameter  range 
of  5- 12pm  and  signal  conduction  velocities  of  30  —7C  m/sec-  They  are  known 
as  gamma  fibers  and  the  cells  they  arise  from  arc  referred  to  as  gamma  motor 
neurons  (or  sometimes  as  fusimotor  neurons) .  There  is  now  good  evidence 
tha  +  there  are  at  least  two  independent  types  of  gamma  fibers,  whose 
properties  will  be  discussed  below. 


In  a  typical  spindle,  there  will  usually  arise  one  large  axon  whose 
principal  termination  winds  around  the  nuclear  bag  region  (a  region  of 
the  spindle  without  muscle  or  contractile  elements)  and  additionally  may 
terminate  also  on  one  or  more  of  the  chain  fibers.  These  are  the  primary 
or  annulospiral  endings .  The  Type  la  axons  serving  these  have  large 
diameters  (l 2  -20pm)  and  do  not  have  terminations  on  other  spindles.  An 
additional  sensory  terminal  is  the  flower-spray  or  secondary  ending, 
associated  primarily,  but  not  exclusively,  with  the  chain  fiuers.  Each 
axon  can  terminate  in  several  such  endings,  and  these  Type  II  axons  are 
about  half  the  diameter  of  the  Type  la  axons .  Endings  may  have 
terminations  on  more  than  one  spindle. 

Mechanical  deformation  of  these  sensory  endings  leads  to  the  develop¬ 
ment  of  electrical  potential  fields  at  the  terminals  which  are  directly 
proportional  to  the  strength  of  the  deformation.  These  generator  potentla  s 
are  accurate  mappings  of  the  forces  operating  on  the  terminals  and  can  follow 
rather  high  frequencies  of  change  in  the  deforming  stimulus.  The  fields 
are  utilized  by  the  sensory  axon  in  the  production  of  nerve  impulses  at 
specialized  triggering  regions  near  the  receptor  endings.  Nerve  impulses 
are  generated  at  a  rate  directly  proportional  to  the  magnitude  of  the 
generator  potential,  hence  there  is  a  continual  transmission  of  impulses 
at  a  frequency  which  is  a  linear  function  of  that  potential  and  thus  of 
the  strength  of  the  deformation.  The  sensory  endings  exhibit  a  high  degree 
of  sensitivity  to  length  changes  —  a  significant  shift  in  firing  frequency 
can  result  from  length  changes  of  ly  a  few  microns.  This  relationship 
can  be  u6ed  to  reconstruct  the  time  course  of  tension  changes  at  the 
nuclear  bag  region  from  observed  trains  of  nerve  impulses. 

The  primary  ending  of  a  spindle  usually  shows  some  discharge  even 
when  the  extrafusal  muscle  fibers  are  at  their  normal  resting  body  length. 

This  is  presumably  due  to  a  small  amount  of  residual  tension  in  the  spindle. 
Even  in  the  absence  of  any  motor  signals  from  the  spinal  cord,  the  firing  rate 
in  the  spindle  will  increase  monotonically  as  a  function  of  increasing 
muscle  length  (from  a  few  pulses  per  second  to  a  hundred  or  more  pulses 
per  second).  This  results  from  the  disposition  of  the  spindle  within  the 
muscle  which  serves  to  transmit  length  changes  in  the  muccie  to  the  bag 


region  where  the  change  is  reflected  as  an  increase  in  bag  tension. 
Conversely,  shortening  of  the  muscle  (either  passively  or  in  response  to 
an  alpha  motor  command  signal)  will  reduce  the  tension  on  the  bag  and 
hence  reduce  the  spindle  la  sensory  fiber  firing  frequency. 

Figure  38  shows  some  typical  plots  of  spindle  sensory  receptor  firing 
frequency  as  a  function  of  muscle  length.  Over  a  considerable  range  this 
relation  is  linear. 
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Figure  38.  Steady-State  Length  Versus  la  Firing  Rate  Relations 
for  Various  Gamma  Fiber  Stimulation  Rates 
(Adapted  from  Ref.  72) 

Recent  studies  of  single  gamma  fibers  ending  on  spindles  whose  primary 
endings  were  being  monitored  have  shown  that  repetitive  stimulation  of 
certain  gamma  fibers  will  produce  a  response  which  consists  of  a  general 
increase  in  the  firing  rate  of  the  primary  ending  (relative  to  its  control 
rate)  as  a  function  of  muscle  length.  This  may  result  in  (1  )  a  family  of 
curves  of  increasing  slope  whosp  relations  are  essentially  linear  (Fig.  38), 
or,  (2)  a  simple  translation  of  the  length/frequency  curve  upward,  or  (3) 
in  a  combination  of  both.  Each  family  of  curves  is  a  function  of  the 
stimulation  frequency  of  the  gamma  fiber. 

The  shift  in  length/frequency  relation  for  these  gamma  fibers  is 
usually  unaccompanied  by  any  significant  increase  in  the  velocity  sensi¬ 
tivity  of  the  fiber  (see  below),  i.e.,  the  gamma  fiber  has  influenced  only 


the  static  gain  of  the  primary  ending;  such  a  gamma  fiber  is  designated 
as  a  static  fusimotor  fiber. 

In  addition  to  this  static  length/firing-frequency  relation,  the 
primary  ending  also  shows  a  strong  sensitivity  to  stretch  or  release 
velocities.  Its  firing  frequency,  with  rapid  lengthening,  can 
increase  to  several  hundred  pulses  per  second,  regardless  of  length, 
and  characteristically  drops  abruptly  to  zero  when  the  muscle  is 
allowed  to  shorten.  This  velocity- sensitive  property  can  also  be  influ¬ 
enced  by  gamma  stimulation,  but  the  population  of  gamma  fibers  with  this 
capacity  is  distinctly  different  from  that  which  influences  the  static 
relation.  Gamma  fibers  which  increase  the  velocity- sensitive  or  dynamic 
part  of  the  response  to  changes  in  muscle  length  with  only  a  small  effect 
on  the  static  gain  are  called  dynamic  fusimotor  fibers .  The  effect  of 
stimulating  these  is  also  dependent  on  the  stimulating  frequency,  and 
thus  the  primary  ending  exhibits  an  inherent  relation  between  firing  rate, 
length,  and  velocity.  The  static  ganma  fiber  increases  la  discharge  fUi 
a  given  length  (but  may  in  fact  decrease  its  relative  sensitivity  to 
stretch);  conversely,  the  dynamic  fiber  greatly  increases  the  firing 
frequency  of  the  primary  ending  during  stretch,  but  leaves  its  steady- 
state  frequencies  essentially  unchanged. 

In  terms  of  the  block  diagram  of  Fig.  ^  and  the  neuromuscular  system 
model  discussion  of  Section  II,  the  actions  of  both  the  static  and  dynamic 
fusimotor  fibers  combine  to  adjust,  and  to  maintain,  the  levels  of  the 
lead  time  constant,  T^.  On  the  other  hand,  only  the  static  fibers  are 
needed  to  provide  a  bias  signal  which,  in  conjunction  with  the  stretch 
(alpha)  reflex  loop,  results  In  the  average  tension,  PG. 

Thus  (Fig.  Jy)  even  at  the  spinal  level,  each  muscle  has  associated 
with  it  a  pool  of  thousands  of  alpha  motor  neuror  at  least  two  systems 
of  sense-organ-controlling  motor  cells,  the  static  and  dynamic  ganma 
neurftns,  three  classes  of  receptors  involving  several  hundred  ctiannels  of 
input  information  to  the  cord,  and  associated  clusters  of  inten.eurons* 

# Neurons  of  the  spinal  cord  are  generally  classified  us  either  sensory, 
motor,  or  interneurons.  To  this  lr '  !  -  class,  therefore,  be  Ion,,  ail  .-ell; 

not  carrying  information  directly  i r< -m  receptor  structures  (  "afferent,  iituiv' 
nor  transmitting,  impulses  to  muscle  fibers  ("efferent  fiber:").  Th**v  are  by 
far  the  largest  population  of  cells  in  the  cord  and  are  essential  t  the 
internal  information  processing  and  integration  within  and  between  i ;  v  '  s  ’  •  s 
of  that  structure. 


which  serve  to  integrate,  distribute,  and  modify  the  activity  within  the 
cord  and  the  control  loopB  by  which  communication  with  the  muscle  is 
effected. 


■  >' y’i' V'<  ■ 1 ^  \  '  ”S  :  ■ : 

Much'"af*tM^  acH^vixyy  f urthemore",  is  transmitted  to  higher  levels 


of  the  nervous  system,  where  a  multiplicity  of  other  sensory  systems  also 
converge.  And  while  patterns  of  motor  activity  can  be  formulated  and 
executed  at  a  local  spinal  level,  we  shall  henceforth  be  concerned  primarily 
with  patterns  which  are  generated  at  higher  centers.  These  are  discussed 
in  the  next  sections. 


Both  alpha  and  gamma  motor  neurons  are  subjected  to  a  variety  of  inputs 
from  centers  within  the  brain  and  from  other  segments  of  the  spinal  cord. 

One  of  the  chief  differences,  however,  may  be  seen  in  their  response  to 
events  taking  place  in  the  muscle  to  which  their  axons  are  directed.  In 
this  respect  it  has  now  been  clearly  demonstrated  that  the  gamma  cell  is 
relatively  unaffected  by  the  peripheral  events  occurring  in  the  muscle  its 
spindles  are  embedded  in.  There  are,  apparently,  no  return  pathways  from 
the  spindles  or  other  muscle  receptors  which  influence  its  immediate  behavior. 

The  alpha  motor  neuron,  on  the  other  hand,  is  subject  to  several  kinds 
of  signals  returning  from  its  muscle.  Most  important  is  the  activity 
generated  by  the  Type  la  axons  from  the  muscle  spindles.  These  axons  make 
direct  ("monosynaptic")  excitatory  connections  with  alpha  cells  innervating 
extrafusal  fibers  in  the  muscle  in  which  they  are  embedded,  and  if  sufficient 
activity  is  arriving  along  la  axons,  output  pulses  will  be  generated  in  the 
alpha  motor  neurons.  One  way  this  can  arise  is  when  the  muscle  is  being 
lengthened,  either  passively  by  some  external  force  or  by  an  antagonist 
muscle.  The  resulting  increase  in  spindle  tension  causes  an  increase  in 
la  firing  rates  and  thereby  an  increase  in  alpha  firing  rates  which,  by 
causing  contraction  of  extrafusal  fibers,  opposes  the  lengthening  process, 
any  shortening  tendency  of  the  muscle,  conversely,  reduces  alpha  activity, 
tending  to  reverse  the  shortening  effect.  Thus  we  have  in  the  alpha/ 
gamma/spindle  complex  the  essential  components  of  a  negative-  feedback 
constant-length  regulator  (the  differential  element  shown  in  Fig.  k), 
knovn  to  the  physiologist  as  the  "stretch  reflex." 


An  alternative  route  for  generating  alpha  motor  neuron  activity- 
lies  in  the  active  production  of  spindle  afferent  activity  by  means  of 
gjftwma  command  signals  which  will  result  in  a  gamma/spindle-controlled 
bombardment  of  the  alpha  motor  cell  (this  is  represented  by  the  yc  path¬ 
way  in  Fig.  4).  This  is  a  possibility  of  immense  significance,  since  it 
opens  tv.<.  possibility  of  indirect  activation  of  the  alpha  cells,  and  hence 
the  possibility  of  generating  direct  and  indirect  command  signals  to  the 
muscles.  Both  pathways  are  shown  in  Fig.  4. 

The  secondary  endings  from  the  spindle  are  also  length-  and  rate- 
sensitive,  but  have  somewhat  different  response  properties  from  the 
primary  endings;  their  central  connections  are  more  complex  and  involve 
inhibition  of  alpha  motor  neurons. 

In  addition  to  the  spindle  receptors  there  are  a  large  number  of 
receptors  embedded  in  the  tendons  of  the  muscle,  the  Golgi  tendon  organs. 
These  also  are  sensitive  to  stretch  and  from  their  placement  in  the  muscle 
appear  to  supply  tension  information  to  the  central  nervous  system.  They 
appear  to  Inhibit  alpha  motor  neurons  innervating  the  same  muscle. 

B.  COMMAND  AND  MONITORING  CENTERS  ZB  THE  BRAIN 

Operating  on,  and  interacting  with,  the  peripheral  neuromuscular  units 
and  associated  spinal  circuits  is  a  hierarchy  of  centers  in  the  brain  itself. 
In  general  these  can  be  expected  to: 

•  Process  information  received  from  the  peripheral  neuro¬ 
muscular,  limb  position,  and  skin  sensors;  integrate  this 
peripheral  somatic  sensory  input  with  other  interoceptive 
(internal  state  monitoring  sensors)  and  exteroceptive 
(external  suite  monitoring  and  detecting  sensors,  such  as 
the  visual,  audivory,  ar.d  vs e titular  systems)  information. 

•  Supply  complex  patterns  of  alpha  and  gamma  command  signals 
of  appropriate  timing,  amplitude,  and  pattern  to  the 
respective  alpha  and  gamma  motor  cells  in  the  spinal  cord 
and  urair  stem  on  the  basis  of  the  available  sensory 
informa  cion  and  stored  programs,  according  to  changeable 
criteria  of  performance. 

•  Make  short-term  and  long-term  modifications  in  the  actual 
organization  jf  the  peripheral  neuromuscular  system  at 
the  spinal  cord  and  brain  stem  levels,  and  provide  for 
storage  of  complex,  patterned, ^killed  motor  performance 
"templates. " 
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All  of  Lh'-  supraspinal  centers  with  which  we  are  concerned  here  have 
comparatively  obscure  functions  relative  to  our  state  of  knowledge  of  the 
peripheral  and  spinal  motor  systems.  This  results  from  the  fact  that  our 
knowledge  of  these  areas  is  derived  largely  from  anatomical  study  of  the 
fiber  connections  between  them,  and  gross  observations  of  the  behavior  of 
animals  in  which  these  centers  or  the  connections  between  them  are  stimu¬ 
lated  or  destroyed.  We  know  little  or  nothing  about  the  signals  that 
enter  them  or  leave  them  under  any  but  the  most  artificial  or  unnatural 
circumstances.  As  a  result  there  is  even  very  little  qualitative  agreement 
on  what  the  functions  of  such  centers  are,  and  it  is  probably  fortunate 
that  there  is  agreement  even  on  the  symptoms  which  characterize  malfunc¬ 
tioning  or  pathological  states. 

Consequently  a  large  portion  of  the  available  data  simply  cannot  be 
incorporated  into  any  model  of  supraspinal  motor  control.  The  remarkable 
ability  of  animals  with  experimental  trauma  to  retain  a  large  degree  of 
control  further  complicates  the  analyst's  attempts  and  suggests  that  in 
the  course  of  evolution  equivalent  systems  have  developed  in  parallel 
with  subtle  differences  distinguishing  them. 

1 .  Sensory  Monitoring  Centers  in  the  Brain 

a.  Organs  monitoring  the  peripheral  neuromuscular  system.  In  addition 
to  supplying  input  to  the  immediate  spinal,  apparatus  controlling  neuro¬ 
muscular  activity,  information  from  the  peripheral  sense  organs  of  muscle, 
the  spindle  afferent s  and  the  Golgi  organs,  is  transmitted  to  adjacent- 
regions  of  the  cord,  and  axons  from  these  receptors  travel  up  the  spinal, 
cord,  establishing  two  important  terminations  in  the  brain  (see  Fig.  i:0)  • 

The  first,  and  probably  most  important ,  terminus  is  in  the  cerebellum , 
a.  structure  which  overlies  the  brain  stem  and  receives  input  from  recep¬ 
tors  in  every  muscle  of  the  body.  Moreover,  this  input,  containing 
presumably  length,  tension,  and  rate  information  (Ref.  75)  is  appar¬ 
ently  laid  c at  in  an  extremely  orderly  fashion,  forming  what  is  some¬ 
times  referred  to  as  a  somatotopic  mapping  of  the  body  musculature  on 
parts  of  the  cerebellar  surface  or  cortex .  The  cortical  surface  of  the 
cerebellum  is  itself  an  exquisite  three-dimensional  orthogonal  matrix  of 
cells  and  axons  (Ref.  7M>  and  it  is  upon  this  orderly  arrangement  of  cellu¬ 
lar  elements  that  the  muscle  systems  of  the  body  are,  in  some  way,  mapped. 
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Cortical  Area* 


Figure  -K).  Major  Supraspinal  Centers  Related  to  Motor  Control 


In  addition,  the  cerebellar  matrix  also  receives,  from  other  pathways, 

(l)  a  continuous  flow  of  impulses  from  skin  receptors  from  all  limbs, 
providing  some  proprioceptive  information  about  the  position  of  the  body 
parts  and  (2)  information  from  the  vestibular  apparatus,  providing  informa¬ 
tion  about  the  relative  position  and  acceleration  of  the  body  in  space. 

The  cerebellum  does  not,  however,  receive  input  from  joint  receptors 
(Ref.  75).  Additional  input  has  been  described,  arising  from  the  auditory 
and  visual  systems  (Ref.  76). 

The  other  terminus  for  muscle  and  proprioceptive  information  is  the 
somatic  sensory  cortex  of  the  cerebral  hemispheres  (Ref.  77),  which  also 
receives  inputs  from  other  somatic  sensory  pathways  involving  touch,  pressure, 
pain,  and  temperature  (Fig*  4o)  •  Another  cortical  area  receives  vestibular 
input.  Structural  integrity  of  the  cerebral  cortex  seems  to  be  indis- 
pensible  to  the  conscious  perception  of  sensory  input,  whereas  damage  to 
the  cerebellum,  which  doe*,  not  seem  to  be  involved  at  all  with  conscious 
perception  of  sensory  input,  leads  to  disorders  in  control  characterized 
by  inadequate  muscle  "gain,"  inadequate  timing  (Ref.  78)  or  phasing  of 
individual  muscles  (Ref.  79)  and  groups  of  muscles,  and  a  well-known 
oscillation  of  a  limb  involved  in  voluntary  tracking  behavior. 

All  of  the  major  exteroceptive  sensory  systems,  with  the  exception  of 
the  olfactory  system,  occupy  distinct  multi synaptic  axonal  tracts  or  path¬ 
ways  which  terminate  in  the  sensory  portions  of  the  thalamus  (a  deeply 
situated  internal  region  of  the  brain)  from  whence  their  signals  are  relayed 
to  distinct  modality-specific  projection  areas  on  the  cerebral  cortex.  This 
cortical  representation  includes  special  areas  for  visual,  auditory, 
vestibular,  and  somatic  sensory  input,  but  other  cortical  areas  appear  to 
involve  overlap  in  sensory  input  and  for  this  reason  are  termed  "association 
areas"  of  the  cortex. 

In  addition  to  these  major  sensory  pathways  to  the  cortex,  each 
exteroceptive  sensory  system  or  modality  appears  to  involve  additional 
collateral  pathways  which  carry  information  to  other  brain  areas  such  as 
the  cerebellum,  and,  of  prime  importance  for  the  discussion  of  motor  mecha¬ 
nisms,  a  central  core  region  of  the  brain  stem  called  the  reticular  forma¬ 
tion  (Fig-  ^0} ■  This  area  runs  nearly 'the  entire  length  of  the  brain  stem  and 
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indeed  extends  well  into  the  spinal  cord  grey  matter.  The  cells  in  this 
structure  are  characterized  by  the  highly  nonspecific  or  integrative  char¬ 
acter  of  the  sensory  input  they  receive,  often  being  activated  by  combina¬ 
tions  of  auditory,  visual,  vestibular,  and  somatic  sensory  stimuli. 

Furthermore  the  reticular  formation  is  the  apparent  recipient  of  much 
of  the  interoceptive  input  of  the  body,  i.e.,  input  from  blood  pressure 
receptors,  chemoreceptors  of  various  sorts,  temperature  receptors,  etc., 
and  is  itself  highly  sensitive  to  the  circulating  levels  of  blood  sugar, 
blood  C02,  and  many  other  substances. 

It  might  be  argued  that  almost  any  area  of  the  brain  could  be 
called  sensory  since  activity  in  that  area  could  be  modified  by  sensory 
input.  But  what  characterizes  all  the  areas  described  so  far  in  this 
section  is  that,  with  the  exception  of  the  cerebellum,  destruction 
of  these  centers  leads  to  a  loss  in  sensory  perception  or  discriminative 
function r  The  cerebellum,  on  the  other  hand,  has  been  included  here 
because  it  receives  direct  input  from  sensory  cell  axons  ascending  from 
the  spinal  cord  and  from  the  vestibular  system. 

2.  Command  Signal  Pathways  from  the  Brain 

Before  considering  the  problem  of  where  specific  command  signals  from 
the  brain  are  generated,  we  consider  the  principal  pathways  by  which  these 
commands  are  transmitted  to  effector  cells  or  networks  in  the  spinal  cord. 
For  convenience,  and  because  it  conforms  to  the  present  terminology  in 
neurology,  we  will  distinguish  two  classes  of  pathways  from  higher  centers 
to  the  spinal  cord.  They  are  (a)  the  pyramidal  tract,*  whose  fibers  arise, 
in  part,  from  the  motor  cortex  of  the  cerebral  hemispheres,  and  form  a  vell- 
del’ined  pathway  along  the  medullary  region  of  the  brain  stem  and  then,  for 
the  most  part,  cross  to  the  other  side  of  the  spinal  cord  to  terminate  on 
or  in  association  with  cells  innervating  muscles  on  the  opposite  side  of 
the  body  from  where  the  pyramidal  fibers  originate;  and  (b)  a  group  of  path¬ 
ways  arising  from  the  brain  stem  and  other  regions,  collectively  known  as 
the  "extrapyramidal"  pathways  (Ref.  80) . 


^Sometimes  referred  to  as  the  "cqrticospinal  tract." 
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Historically,  it  has  been  assumed  that  the  pyramidal  tract  is  the  route 
of  voluntary  and  skilled  command  signals  and  that  these  common  signals  go 
directly  to  alpha  motor  neurons .  It  was  felt  this  was  duo  to  several  rea¬ 
sons:  the  pyramidal  tract  arises  partly  from  the  cerebral  cortex,  the  cor¬ 
tex  is  associated  with  the  most  complex  forms  of  behavior,  and  electrical 
stimulation  of  the  surface  of  the  cortex  produces  movement.  None  of  these 
assumptions  appears  to  be  entirely  valid,  however,  for  the  following  reasons: 

•  It  is  only  in  prinntes,  particularly  humans,  that  significant 
numbers  of  pyramidal  tract  fibers  even  terminate  on  motor 
(as  opposed  to  intemeuron)  cells  in  the  spinal  cord 

(Refs.  81  ,  82)- 

•  It  appears  (Refs.  7 6,  83)  that  the  motor  cortex  exerts  control 
on  both  alpha  and  gamma  cells,  so  that  it  is  unlikely  that 
the  pyramidal  tract  is  a  "private  line"  from  motor  cortex 

to  alpha  cells. 

•  It  is  apparent  that  skilled  voluntary  movement  is  possible  in 
experimental  animals  when  the  pyramidal  tract  is  interrupted 
in  the  brain  stem  (Ref.  8l  ),  so  that,  if  voluntary  movement 
is  initiated  cortically,  alternate  descending  routes  must  be 
available  for  the  signals. 

•  Many  of  the  fibers  constituting  the  pyramidal  tract  are  not, 
in  fact,  of  cortical  origin. 

In  experiments  on  monkeys  where  the  pyramidal  paths  are  cut  on  both 
sides  of  the  brain,  the  animals  are  able  to  recover  normal  movement  to  p 
large  extent,  but  with  some  reduction  in  the  speed  or  rapidity  of  movement 
and  a  greater  tendency  toward  fatigue.  Moreover,  fine  dissociative  control, 
for  example  the  ability  to  move  a  single  finger,  is  lost  and  thereafter 
finger  movements  involve  all  five  digits  at  once  (Ref.  81  ). 

There  appears  to  be  some  differentiation  of  fiber  types  of  pyramidal 
tract  cells.  The  larger,  faster  conducting  fibers  show  intermittent  activity 
and  tend  to  terminate  on  motor  neurons  which  innervate  distal  phasic  muscles 
(such  as  the  digits),  while  the  smaller,  slower  fibers  probably  tend  to  end 
more  on  interneurons  related  to  alpha  and  gamma  fibers  of  proximal  tonically 
active  muscles  (Refs.  8^+,  85).  Fibers  of  the  fast  conducting  system  probably 
establish  a  direct  excitatory  connection  with  alpha  motor  neurons. 

In  recent  studies  of  single  neurons  in  the  primate  motor  cortex,  cells 
sending  axons  to  the  pyramidal  tract  have  been  observed  which  undergo  marked 
changes  in  discharge  pattern  in  associated  contralateral  arm  movements 
(Ref.  86).  Moreover,  on  the  basis  of  conduction  velocity  measurements, 


101 


there  appea'  to  be  at  least  two  classes  of  pyramidal  tract  cells —  the 
faster  conducting  cells  apparently  fire  only  in  association  with  discrete 
peripheral  movements  without  a  background  discharge;  the  slower  cells,  on 
the  other  hand,  have  a  more  or  less  continuous  background  discharge  even 
in  the  absence  of  movement  which  may  either  increase  or  decrease  during 
spontaneous  voluntary  movements  (Ref.  86). 

In  addition  to  its  contribution  to  the  pyramidal  tract,  the  motor 
cortex  has  extensive  connections  with  a  number  of  subcortical  areas, 
including  the  basal  ganglia,  reticular  formation,  and  cerebellum.  Hence 
damage  to  the  motor  cortex  leads  to  far  more  severe  and  irreparable 
loss  of  motor  control  than  does  pyramidal  tract  section. 

The  extrapy ramlda 1  system  consists  of  a  number  of  distinct  pathways 
arising  from  centers  in  the  brain  stem  and  terminating  on  interneurons  in 
the  spinal  cord  from  which  they  all  appear  to  exert  control  on  the  gaama 
pathways.  The  main  centers  of  origin  we  shal1  be  concerned  with  are  the 
reticular  formation,  already  mentioned,  from  wheno  •  the  reticulosrjinal 
tract  emerges;  the  red  nucleus,  giving  rise  to  the  rubrospinal  tract;  and 
the  nucleus  of  the  vestibular  system,  giving  rise  to  the  vestibulospinal 
tract.  While  we  do  not  know  in  any  precise  detail  how  these  pathways 
contribute  to  the  over-all  coordination  of  precise  movement,  we  can  give 
a  rough  characterization  of  their  peripheral  effect.  The  vestibulospinal 
tract  appears  to  be  concerned  primarily  with  postural  readjustments  to 
changes  in  body  orientation  with  respect  to  gravity.  This  has  been  demon¬ 
strated  by  testing  the  effect  of  labyrinthine  stimulation  on  feedback  loops 
at  the  neuromuscular  level  (Refs.  87-89).  From  such  experiments  we  can 
say,  for  example,  that  in  standing-man  the  effect  of  an  increased  gravi¬ 
tational  force  would  be  to  increase  the  intensity  of  the  muscle  spindle 
response  to  increased  gravitational  stress  by  means  of  combined  alpha  and 
gamma  control  signals.  When  the  tody  is  tilted  in  space,  appropriate 
readjustments  in  the  position  of  the  supporting  limbs  are  made,  tending 
to  restore  the  original  orientation  of  the  body. 

The  rubrospinal  tract  appears  to  have  a  major  influence  on  the  gamma 
motor  system  and  Indeed  there  appear  to  be  subdivisions  in  the  red  nucleus 
for  selective  control  of  dynamic  or  static  gamma  fibers  (Refs.  <90,  91), 
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and  therefore  one  would  be  tempted  to  guess  that  overall  rat  i  os  "f  stall  c- 
gamma/dynaml e - gamma  activity  are  regulated  here.  While  it  is  not  clear 
whether  specific  muscles  can  oe  controlled  selectively  by  thi.  pathway, 
it  is  fairly  certain  that  muscle  groupings  are  differentially  activated, 
e-g.,  the  extensors  or  flexors  of  a  given  limb  (Ref.  91)- 

In  addition  to  its  involvement  in  the  motor  control  of  autonomic 
functions,  the  reticulospinal  tract  has  been  shov.j  to  exert  powerful 
excitatory  or  inhibitory  effects  on  interneurors  in  the  cord  arid  on  gamma 
activity  (Refs.  92  —  9*0*  Moreover,  the  reticular  system  seems  to  be  able 
in  some  sense  to  set  the  levels  of  sensory  input  over  different  sensory 
pathways  arising  in  the  spinal  cord. 

For  the  formulation  of  command  signals  to  be  effective  in  a  given 
situation,  there  must  be  a  continuous  inflow  of  information  from  sensory 
input  channels  to  motor  command  centers.  The  reticular  formation  is  an 
example  of  a  self-integrated  sensory-motor  system,  but  a  number  of  other 
critically  important  sensory  motor  loops  also  exist  in  the  brain. 

As  previously  pointed  out,  the  cerebellum  receives  what  is  perhaps  the 
most  complex  array  of  information  concerning  body  and  limb  posit ion  and 
muscle  tension,  and  it  is  essential  to  the  orderly  execution  of  voluntary 
activity.  Toward  this  function,  the  cerebellum  directs  its  output  to 
higher  centers  in  the  brain,  principally  to  the  motor  cortex  of  the 
cerebral  hemispheres.  The  loop,  moreover,  is  a  closed  one,  for  fibers 
from  the  motor  cortex*  provide  a  return  path  through  the  red  nucleus  and 
reticular  formation  back  onto  the  cerebellar  cortex.  Other  loops  involving 
the  cerebellum  consist  of  fiber  connections  to  and  from  the  red  nucleus, 
and  the  reticular  formation  directly.  Stimulation  or  destruction  of  any 
of  the  centers  involved  in  this  loop  will  result  in  marked  changes  in  gamma 
and  spindle  activity  observed  peripherally  (Refs.  79,  79,  92,  9^ ) . 

Another  area  of  interest  in  motor  functions  is  a  cluster  of  subcortical 
nuclei  in  the  cerebral  hemispheres  which  make  complex  connections  with  the 

*The  motor  cortex,  moreover,  has  additional  sensory  inputs  via  its 
connections  with  the  sensory,  visual,  and  auditory  cortices.  Doth  directly 
and  through  cortical  association  areas. 


motor  cortex  and  with  the  brain  stem.  They  are  the  so-called  basal  ganglia, 
and  these  centers  nre  frequently  implicated  as  the  site  at  which  complex 
"stored-program"  motor  activities  may  be  initiated.  There  are  now  on  record 
(see,  for  example,  Refs.  95  and  96)  sufficient  observations  of  long-term 
cnains  or  sequences  of  motor  and  other  behavioral  activity,  such  as  those 
observed  in  mating,  food  gathering  and  consumption,  etc.,  which  can  be 
repeatedly  triggered  by  electrical  or  chemical  stimulation  of  precisely 
localized  areas  of  the  brain,  to  suggest  that  in  such  cases  the  entire 
sequence  of  behavior  is  not  generated  at  the  locus  of  stimulation,  but  is 
merely  triggered  from  that  locus.  This  has  led  to  the  hypothesis  that  the 
full  sequential  program  is  stored  in  some  fashion  at  some  area  of  the  brain, 
and  the  basal  ganglia  are  favored  by  a  number  of  observers  as  a  possible 
site  for  program  storage.  Unfortunately,  like  much  of  the  evidence  relevant 
to  motor  behavior,  the  evidence  is  highly  indirect  and  must  be  regarded  at 
present  as  speculative.  Nevertheless,  trauma  to  the  basal  ganglia  leads  to 
more  or  less  profound  interference  with  normal  motor  function. 

0.  MODELS  OF  SUPRAflPUKL  C0MER0L  OF  MOTOR  ACTIVITY 

In  this  section  we  will  consider  some  data  resulting  from  a  number  of 
recent  investigations  of  the  detailed  mechanisms  of  motor  control  systems 
of  the  brain.  The  first  example  will  examine  how  a  system  functioning  as 
a  regulator  of  the  internal  environment  interacts  with  the  basic  neuro¬ 
muscular  spinal  cord  networks  previously  considered,  and  how  this  system 
is  organized  to  minimize  the  error  in  the  regulator  and  to  minimize  the 
effect  of  fluctuations  in  load.  The  second  example  illustrates  a  very 
simple  situation  in  which  information-processing  centers  can  enable  an 
external  stimulus  to  be  "tracked."  A  third  section  considers  some  impor¬ 
tant  timing  relations  involved  In  comp  ox  pattern  recognition/response 
situations  involving  the  cerebral  cortex. 

1 .  8ubcortioal  Interoceptive-Tracking  Compensatory  Control 

First  we  consider  a  continuously  active  regulatory  motor  system  whose 
physiological  parameters  and  mechanisms  have  been  studied  far  more  exten¬ 
sively  than  any  other.  From  It  we  can  derive  a  number  of  Ir.'potheses  about 
how  compensatory  systems  are  organized.  Indeed,  no  be  er  example  of  the 


detailed  workings  of  the  nervous  system  can  be  found  than  the  action  of  the 
respiratory  motor  system  which  results  in  the  periodic  inflation  and  defla¬ 
tion  of  the  lungs  (Fig-  M).  Many  muscles  are  involved  in  this  activity, 
but  we  consider  here  only  the  intercostal  muscles  which  cause  an  increase 
or  decrease  in  the  volume  of  the  chest  by  moving  the  ribs. 

The  function  of  the  respiratory  control  centers  in  the  brain  stem 
reticular  formation  is  to  regulate  the  level  of  oxygen  and  carbon  dioxide  in 
the  blood,  and  this  is  achieved  by  changing  the  ventilation  rate  of  the  lungs 
by  varying  the  rate  and/or  the  depth  of  respiration.  In  quiet  respiration 
only  the  muscles  of  Inspiration  are  used,  and  expiration  occurs  passively 
from  elastic  recoil  once  the  action  of  the  inspiratory  muscles  has  ceased. 

In  heavier  respiration,  the  muscles  of  expiration  become  active. 

One  of  the  most  potent  stimuli  to  increase  respiration  is  an  elevated 
level  of  carbon  dioxide,  which  apparently  stimulates  chemosensittve  neuronal 
elements  in  the  brain  stem  directly,  and  also  stimulates  a  network  of  chemo- 
sensitive  cells  located  in  the  walls  of  several  major  blood  vessels,  whose 
output  also  reaches  the  brain  stem.  These  are  connected  to  brain  stem 
networks  intrinsically  organized  to  produce  alternating  bursts  of  impulses 
which  are  transmitted  to  motor  neurons  in  the  spinal  cord.  The  organiza¬ 
tional  details  of  these  brain  stem  networks  are  not  well  understood,  but 
experiments  suggest  the  existence  of  two  mutually  inhibitory  pools  of 
neurons  which  are  active  primarily  during  inspiration  and  expiration, 
respectively. 

The  control  of  respiratory  volume  is  effected  by  several  different  means. 
First,  an  increase  in  blood  CO2  can  cause  an  increase  in  frequency  of  firing 
of  an  individual  cell  during  the  inspiratory  cycle.  Second,  the  respiratory 
rate  may  be  increased  by  altering  the  duration  of  the  burst  and  the  inter¬ 
burst  period.  Third,  the  antagonistic  action  of  expiratory  ceils  may  be 
reduced  during  the  inspiratory  phase,  but  be  accelerated  during  the  expira¬ 
tory  phase.  Fourth,  there  are  apparently  a  large  number  of  normally  inactive 
neurons  in  the  brain  stem  which  can  be  recruited  into  an  increased  respira¬ 
tory  effort,  thereby  increasing  the  total  drive  to  the  rhinal  cord. 

From  a  number  of  studies  we  find  that  to  every  state  of  blood/gas  level 
there  will  correspond  a  specific  output  pattern  from  the  brain  stem  which 


effectively  commands  the  spinal  neuromuscular  apparatus  to  effect  a 
maneuver  adequate  for  maintaining  a  desired  blood/ gas  level  or  for  off¬ 
setting  any  deviations  from  the  optimum  level.  These  commands  are 
equival ent  to  a  volume  of  air  to  be  moved  in  and  out  of  the  lungs .  But 
even  though  the  parameters  of  the  output  are  variable,  the  output  is 
always  patterned  in  a  stereotyped  way,  with  periods  of  approximately 
constant  frequency  nerve  impulse  bursts  alternating  with  silence. 

The  firing  patterns  of  motor  neurons  in  the  spinal  cord  are  similar 
in  many  respects  to  those  in  the  brain  stem,  and  electrical  recordings 
from  individual  motor  neurons  supplying  the  external  intercostal  muscles 
(which  are  insp  atory)  and  the  interrial  intercostal  muscles  (expiratory) 
show  again  the  alternating  burst/silence  pattern  of  activity.  Indeed,  the 
phasing  of  firing  of  these  two  groups  of  motor  cells  with  inspiratory  and 
expiratory  activity  extends  also  to  the  garana  motor  neurons  in  these  pools. 
In  fact,  it  has  been  shown  that  the  pattern  of  firing  of  the  gamma  cells 
is  closely  related  to  the  carbon  dioxide  level  of  the  blood,  suggesting 
that  the  command  signals  from  the  brain  are  relayed  in  parallel  to  both  the 
alpha  and  the  gamma  systems  (Ref.  97),  see  Fig.  hi. 

There  is  now  considerable  evidence  that  gamma  activity  slightly  leads 
alpha  activity  in  respiratory  neurons.  The  evidence  for  this  comer,  from 
direct  simultaneous  observation  of  several  neurons,  but  is  further  strength¬ 
ened  by  the  finding  that  when  the  dorsal  roots  are  cut  (thereby  interrupting 
the  spindle  flow  to  the  alplia  motor  ceils)  the  alpha  cells  may  actually  fail 
to  fire  during  the  normal  phase  of  respiration,*  while  the  gamma  ceils  con¬ 
tinue  to  fire.  This  suggests  that  alpha  discharge  may  actually  be  dependent 
on  a  considerable  amount  of  gamma -produced  spindle  support.  In  addition, 
observation  of  spindle  discharge  during  contraction  of  respiratory  muscles 
shows  that,  in  contrast  to  what  might  be  expected  during  renpim'  icn ,  sj  indie 
discharge  Increases;  we  conclude,  therefore ,  that  increased  gamma  bias  hnc 
offset  the  unloading  effect  of  contraction.  These  observations  a; ply  to 
both  inspiratory  and  expiratory  intercostal  muscles  (Ref:  .  ■<•  ,  \  . 

*In  humans,  dorsal  root  section  here  leads  to  a  j«tmlysjs  of  these 
respiratory  muscles  of  which  the  subject  is  unaware  (Ref.  <■  ). 


This  parallel  transmission  of  a  command  si  nal  from  the  brain  stem 
insures  that  adequate  ventilation  will  occur  in  spite  of  changes  in  muscle 
power,  airway  resistance,  or  driving  pressures,  for  during  the  execution 
of  the  command  signal  any  mismatch  between  the  required  contraction 
(signaled  via  the  gamma  system)  and  the  actual  contraction  will  be  signaled 
by  the  spindle  afferent  (which  measures  the  difference  between  "required" 
muscle  length  and  actual  muscle  length) .  If  the  shortening  of  the  muscle 
is  too  small,  for  example  as  a  result  of  increased  airway  resistance,  this 
will  immediately  cause  a  burst  of  impulses  from  the  spindle  to  Increase 
the  level  of  excitation  to  the  corresponding  alpha  motor  neuron.  This 
hypothesis  lias,  in  fact,  been  tested  in  experiments  in  which  the  airway 
resistance  was  suddenly  altered  just  prior  to  a  respiratory  cycle  (Ref.  10£). 
The  effect  on  alpha  motor  neuron  discharge  is  immediate  (i.e.,  much  too 
fast  to  have  arisen  by  CO2  stimulation  of  the  brain  stem),  which  supports 
the  hypothesis  that  the  gamma/ spindle  loop  can  be  used  to  drive  the 
neuromuscular  system  as  a  "follow-up  servo." 

Further  investigation  of  the  gamma  fiber  input  to  the  intercostal 
muscles  has  revealed,  in  addition  to  the  intermittent  discharge  phase- 
locked  with  respiration,  a  "tonic"  f  ontinuous)  gamma  component.  This 
latter  activity  can  be  influenced  by  cerebellar  stimulation  and  tilting 
the  head  (Ref.  100)-  In  the  case  of  the  intercostal  musci.es,  this  is 
correlated  with  the  fact  that  these  muscles  have  a  dual  function —  that 
of  respiration  on  the  one  hand  and  postural  control  on  the  other.  Thus, 
two  independent  routes  of  gamma  command  signals  impinge  on  common  spindles; 
one  from  the  respiratory  system  and,  simultaneously,  one  from  the  tonic 
postural  or  position-determining  system.  As  a  result,  the  tension  of 
intercostal  muscles  periodically  fluctuates  at  an  amplitude  determined 
by  the  phasic  gamma  system.  The  fluctuation  occurs  about  an  average 
tension  determined  by  postural  demands  via  the  tonic  gamma  system.*  Since 
both  the  tonic  and  phasic  gamma  input  can  activate  toe  same  spindle,  it 
Is  concluded  that  several  distinctly  different  gamma  pathways  can  reflexly 
command  the  same  pool  of  alpha  motor  neurons  (Ref.  100)* 

""It  is  possible  that  some  of  the  tonic  gamma  activity  is  also  related 
to  respiration  and  determiner,  the  mid- thoracic  position  around  which  the 
respiratory  excursions  are  superimposed. 


We  have  introduced  this  example  in  order  to  consider  a  situation  of 
minimum  complexity,  namely,  that  of  a  neural  regulatory  system  "tracking" 
a  constant  internally  generated  reference  signal.  Two  loops  in  the  con¬ 
troller  are  involved:  (l  )  a  conventional  outer  feedback  loop  carrying 
information  concerning  the  state  of  the  controlled  variable  (blood  CO2 
level),  and  (2)  a  peripheral/spinal  feedback  loop  which  enables  the  system 
to  remain  relatively  insensitive  to  changes  in  muscle  dynamics  (for  example, 
in  the  presence  of  fatigue)  or  load  changes  (as  in  changes  in  airway 
resistance).  Indeed,  we  have  considered  this  example  primarily  in  order 
to  introduce  some  of  the  peripheral  physiological  mechanisms  in  skilled 
tracking  behavior,  regulated  at  a  subcortical  level.  In  terms  of  Fig.  4o, 
this  subcortical  command  system  amounts  only  to  that  shown  in  Fig.  42. 


a  Command 
Signals 
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Figure  4 .  Command  Subsystem  of  Fig-  4o  Related  to  Respiratory  Control 

2,  Exteroceptive  Tracking  System 

We  now  wish  to  extend  the  complexity  of  the  situation  by  considering 
bow  externally  genem t.ed  t,j  Me- varying  r.jgnn Ir.  enn  be  tracked  ;  we 

wish  to  examine  tne  servo  properties  of  at  neurophysiological  exteroceptj vs 
tracking  system. 
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An  interesting  example  of  such  a  system  is  afforded  by  the  visual 
tracking  mechanisms  of  the  brain  which  enable  an  animal  to  center  a  visual 
target  on  the  optical  axis  of  the  eye  where  visual  acuity  is  greatest. 

A  complete  neural  system  adequate  for  such  activity  appears  to  exist  in 
the  brain  stem  and,  indeed,  there  is  evidence  from  recent  experiments  on 
monkeys  that  simple  tracking  behavior  does  not  necessarily  involve  sensory 
and  motor  cortical  areas,  and  that  even  manual  tracking  of  a  simple  food- 
reward  stimulus  can  be  performed  when  only  subcortical  areas  are  available 
for  the  effort  (Ref.  10^).  This  correlates  with  the  fact,  pointed  out 
previously  (Fig.  ^0),  that  a  number  of  subcortical  centers  have  access 
to  visual,  auuitory,  and  proprioceptive  information,  and  that  complex  (if 
not  all)  motor  patterns  can  be  generated  in  the  absence  of  a  pyramidal 
tract,  at  least  in  primates.*  A  scheme  for  such  behavior  using  subcortical 
centers  can  be  postulated  by  appealing  to  a  synthesis  of  prototype  modes 
of  behavior  that  have  been  demonstrated  in  a  variety  of  animal  experiments. 
In  principle,  such  a  system  requires  target  position  and  velocity  informa¬ 
tion  to  be  processed  into  command  signals  available  to  the  motor  nuclei  of 
the  eight  extraocular  muscles  of  the  eyes,  whose  concerted  action  enables 
the  eyes  to  move  to  a  position  appropriate  for  target-centering. 

Target  information  is  fed  into  this  system  in  several  different  ways. 
First,  owing  to  the  optical  properties  of  the  eye  itself,  there  is  a  point- 
to-point  mapping  of  the  visual  field  onto  the  retina  of  each  eye.  The 
mapping  follows  the  normal  inversion  seen  in  any  lens  system  with  points 
in  the  visual  field  to  the  right  of  the  vertical  meridian  being  projected 
onto  the  left  side  of  each  retina,  etc.  Thus  the  spatial  ordering  of  the 
target  field  is  preserved  by  the  anatomical  ordering  of  receptor  cells  on 
the  surface  of  the  retina.  This  spatial  arrangement  is  preserved  at  higher 
levels  of  the  nervous  system,  and  in  particular  it  is  preserved  by  a  point- 
to-point  mapping  onto  the  surface  of  structures  in  the  mid-brain  known  as 
the  superior  colliculi  (Ref.  105).  These  are  paired  structures  overlying 
the  brain  stem,  and  on  each  colliculus  is  mapped  one -half  of  the  opposite 
visual  field,  with  each  retina  overlapping  in  its  projection.  That  is, 

*0f  course,  nonpyramldal  cortical  motor  paths  to  the  spinal  cord  also 
exist. 


the.  right-hand  visual  field  projected  on  the  left  side  of  both  retinas  is 
napped  onto  the  entire  surface  of  the  left  superior  colliculus  (Fig.  J0) . 

Recent  studies  have  shown  that  in  addition  to  this  position  informa¬ 
tion,  activity  in  optic  nerve  fibers  coming  from  the  retina  carries 
information  concerning  target  velocity  and  direction  of  travel  (Refs.  1 06 
and  107)  anu  probably  also  information  about  target  shape,  boundary,  and 
contrast  with  surroundings  (Ref.  1  06) . 

From  the  available  sensory  information  we  assume  that  command  signals 
appropriate  to  the  tracking  of  a  target  are  generated  from  the  colliculus 
itself,  for  when  a  point  on  the  surface  of  the  colliculus,  corresponding  to 
'  a  specific  point  is  the  visual  field,  is  stimulated,  a  conjugate  movement, 
of  both  eyes  occurs,  whose  magnitude  and  direction  are  such  as  to  tend  to 
center  the  target,  i.e.,  move  the  target  projection  point  on  the  surface 
toward  the  zero/zero  horizontal  and  vertical  meridian  points  (Refs.  1 08 
and  1 09^ • 

Thus,  the  colliculus  converts  the  sensory  projection  mapping  into  a 
command  signal  vector  which  nulls  the  mapping  of  a  point  on  the  surface. 

The  command  signals  generated  by  the  colliculus  are  transmitted  by 
direct  pathways  to  the  clusters  of  motor  cells  (motor  nuclei)  in  the  brain 
stem  whose  axons  control  the  muscles  of  the  eye  (see  Figs.  ^  and  jO)  .  It 
is  at  this  level  also  that  additional  compensatory  Information  from  the 
vestibular  system  concerned  with  head  position  and  angular  velocity  is 
integrated  into  the  final  motor  command.  In  addition,  pathways  from  the 
colliculus  to  the  cerebellum  and  from  the  vestibular  nuclei  to  the  cerebellum 
enable  the  cerebellum  to  participate  in  the  coordinated  and  smooth  execution 
of  target-centering  actions.  Furthermore,  output  pathways  from  the  superior 
colliculus  to  the  reticular  formation  and  spinal  cord  can  generate  head 
and  neck  movements  associated  with  the  tracking  of  targets,  and  these  we 
will  presume  to  depend  on  spinal  regulatory  mechanisms  already  described. 

Detailed  studies  of  eye  movement  in  tracking  situations  also  show  that, 
as  in  the  case  of  the  respiratory  system  motor  output,  the  over-all  response 
is  not  arbitrary,  but  appears  to  be  synthesized  from  patterned  or  stereo¬ 
typed  subcomponents.  In  the  visual/motor  system,  two  principal  modes  are 
available,  one  a  quick  step  change  in  rtuscle  length  (the  saccadic  movement) 


..  scT, 


a)  Projection  of  fltrai  Hold  onto  surfoce  of  colliculus.  T,N  rof or  to  nosol  ond 
temporal  coordinates  of  powers  rotative  to  vertical  meridian  *  ond  -refer  to 
coordinates  relative  to  horhontot  meridian,  (from  tOS) 

Anterior 


MM.  From  Midlint 

b)  Points  on  ft  Superior  colliculus  surfoce  whose  stimulation  produces  motion 
shown.  L  -  argreus  deviation  to  the  left / 1 refers  to  motions  above  or  below 
horirontal  meridian,  (from  108 J 
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c!  motion  of  ft  and  L  eye  In  response  to  repeated  stimulation  of  single  point 

on  colliculus.  In  each  case  eye  slocks  from  different  direction  of  gore,  (from  109) 
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~ock  niagrair  of  Eye  Tracking  System 
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which  centers  the  target  and  the  other  a  constant  angular  velocity  rotation 
of  the  eye  (pursuit  movement)  which  permits  following  of  tne  target  once 
it  is  centered;  in  most  situations  complex  eye  motions  are  superpositions 
or  successions  of  these  basic  modes. 

A  number  of  additional  generalizations  of  importance  emerge  from  the 
study  of  the  two  subcortical  systems  which  have  been  described,  and  these 
are  valid  in  their  application  to  motor  control  systems  generally. 

•  Motor  systems  are  organized  around  reciprocally  acting 

(and  usually  reciprocally  inhibitory)  antagonist  components. 

•  Precision  command-following  in  the  presence  of  motor  and 
load  variations  is  provided  by  low  delay  feedback  loops 
at  the  motor  unit  level.  Thus  a  patterned  motor  command 
results  in  a  nearly  duplicate  response  with  shorter  delays 
and  more  precision  than  would  be  possible  in  an  open-loop 
system. 

•  For  this  reason,  patterned  coordinated  command  signals 
generally  involve  coactivation  of  the  alpha  and  gamma  motor 
cells . 

•  Independent  motor  command  signals  can  play  simultaneously 
and  in  parallel  in  effector  networks. 

CORTICAL  CONTROL  FUNCTIONS 
1 .  The  Nature  of  Cortical  Control 

The  systems  discussed  so  far  are  apparently  capable  of  operating 
autonomously  at  a  subcortical  level  in  the  execution  of  certain  control 
or  tracking  tasks.  At  the  subcortical  level  they  operate  on  a  more  or 
less  continuous  stream  of  sensory  input,  and  sensory  feedback  information. 
In  their  processing  of  this  information,  and  in  the  synthesis  of  their 
output  from  subcortically  available  motor  patterns,  generated  on  a  propor¬ 
tional  or  rate  control  basis  with  appropriate  mechanisms  for  equalization 
of  body  position  or  load  changes,  they  appear  to  operate  essentially  as 
quasi- linear  pure  gain  controllers.  This  is  probably  typical  of  the 
capabilities  of  subcorticn 1  motor  control  systems,  buu  in  the  presentation 
of  these  systems,  in  order  to  illustrate  some  intrinsic  mechanisms  within 
them,  we  have  been  forced  to  ignore  the  influence  that  higher  centers  can, 
and  normally  do,  have  on  them.  t 


In  what  follows,  we  would  like  to  consider  some  of  the  "metacontroller" 
problems  that  are  inherent  to  the  function  of  higher  or  cortical  areas  of 
the  brain. 

Even  in  the  case  of  visual  tracking  there  are  several  logical  or 
decisional  functions  involved,  for  example, 

•  Is  the  stimulus  "interesting"  or  important?  Are  its 
parameters  of  movement  and  conformation  matched  to  certain 
"filters"  in  the  brain  which  monitor  the  available 
information? 

•  Should  the  stimulus,  even  if  interesting,  be  tracked  at 
all,  given  the  constellation  of  other  factors  concerning 
the  internal  and  exterual  state  of  the  body? 

•  If  the  decision  is  made  to  track,  by  what  mode  and  with 
what  precision  should  the  action  be  undertaken? 

We  know,  in  answer  to  the  first  question,  that  several  areas  of  the 
brain  receiving  polysensory  input  receive  highly  specific  kinds  of  sensory 
information.  Indeed,  specific  neurons  in  the  reticular  formation,  superior 
colliculus,  and  cerebral  cortex  appear  capable  of  responding  only  to  highly 
specialized  kinds  of  stimuli  (Refs.  106,  110-11?.’)  which  are  of  great 
natural  importance  to  survival;  for  example,  in  the  detection  of  prey  or 
predators.  Their  ability  to  react  select! /ely  to  certain  kinds  of  stimuli 
("property  filtering")  provides  the  physiological  basis  for  the  detection 
of,  and  the  focusing  of  attention  on,  such  stimuli  in  preference  to 
unimportant  or  neutral  events,  and  for  the  alerting  of  appropriate  areas 
for  response  initiation. 

It  is  also  obvious  that  a  process  such  as  visual  tracking,  unlike 
respiratory  or  cardiovascular  control,  is  not  entirely  obligatory  or 
involuntary,  but  Involves  logical  start  and  stop  decisions.  In  humans  this 
is  apparently  a  cortical  function,  and  with  damage  to  certain  cortical 
areas  neurological  patients  are  unable  to  track  a  stimulus  unless  commanded 
to  do  so  or  are  unable  to  "let  go"  of  the  object,  i.e.,  they  cannot  stop 
the  tracking  operation  (Ref.  113).* 


*Behavior  analogous  to  this  has  also  been  observed  in  hand-grasping  of 
objects  by  monkeys  with  pyramidal  tract  lesions  (Ref.  8l  )  . 
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Finally,  if  the  decision  is  made  to  track,  what  mode  should  be  used? 

The  colliculus  is  capable  of  generating  signals  which  cause  the  eyes  to 
turn  appropriately,  but  there  are  alternate  pathways  available  to  it 
which  can  initiate  head-turning  or  body- turning  (Refs .  11 4 ,  115)*  In 
some  cases  the  mode  of  output  is  even  dependent  on  the  detection  and 
recognition  process.  For  example,  humans  generally  cennot  voluntarily 
generate  a  smooth  constant-velocity  eye  movement  unless  they  are  tracking 
a  target  moving  with  that  velocity.  Moreover,  it  may  be  necessary  to 
transfer  the  tracking  operation  in  whole  or  in  part  to  other  effector 
systems,  and  in  the  case  of.  manual  control,  for  example,  the  process  of 
visual  tracking  is  essentially  deferred  to  muscles  of  the  arm  and  hand 
which  are  not  intrinsically  related  to  eye  movement  at  all.  But  this 
again  requires  a  prior  logical-  decision;  hence  it  is  important  to  bear 
in  mind  the  vast  difference  between  compensatory  tracking  of  a  visual 
stimulus  with  the  oculomotor  apparatus  and  compensatory  tracking  with 
some  manually  controlled  device.  We  now  know  that  this  latter  task  can 
be  performed  by  primates  (Ref .  11 6) ,  but  there  is  no  evidence  that  lower 
animals  can  do  this. 

Thus,  while  the  mechanisms  for  accurate  pure-gain  types  of  tracking 
behavior  exist  at  subcortical  levels,  they  are  subject  to  an  increasingly 
complex  hierarchy  of  logical  decision-making  structures  and  it  is  likely 
that  the  cerebral  cortex  is  increasingly  involved,  in  an  evolutionary 
sense,  in  precisely  those  metacontroller  functions. 

Moreover,  in  contrast  to  the  situations  considered  above  in  which 
tracking  behavior  occurs  in  response  to  time-varying  or  random  sensory 
signals,  there  is  a  decisive  need  for  the  nervous  system  to  be  able  to 
initiate  motor  commands  from  internal  sources  and  to  predict  the  future 
behavior  of  the  external  world  so  that  appropriate  motor  action  can  he 
initiated  in  advance  of,  instead  of  in  response  to,  certain  stimuli.  It 
seems  likely  that  the  cerebral  cortex  is  indispensable  for  such  precogni- 
tive  or  predictive  control  of  movement  in  which,  in  effect,  complex  trackable 
stimuli  are  internally  generated. 

As  a  basis  for  such  a  process,  we  assume  that  the  cortex,  in  conjunc¬ 
tion  with  other  brain  centers,  has  considerable  ability  to  learn  or  store 


complex  sensory  patterns,  to  synthesize  complex  patterns  out  of  simpler 
patterns,  and  finally  to  transfer  stored  sensory  patterns  to  motor  centers 
where  they  can  be  "tracked." 

There  is  now  good  evidence,  based  on  studies  of  the  ability  of  the 
nervous  system  to  transfer  learned  information  from  one  half  of  the  brain 
to  the  other,  that  some  complex  sensory  and  motor  patterns  are  indeed 
stored  at  cortical  levels.  Transfer  of  visual  pattern  recognition  activity, 
for  example,  is  dependent  on  an  intact  visual  receptive  cortex.  Manual 
skills,  on  the  other  hand,  are  very  poorly  learned,  from  purely  visual 
experience,  and  acquisition  of  skill  seems  rather  to  depend  on  somatic 
sensory  input  from  the  limbs  and  cannot  be  transferred  from  one  hemisphere 
to  the  other  without  both  somatic  sensory  and  motor  cortices  (Ref.  10^). 

Thus,  we  see  a  functional  requirement  for  the  cortex  in  the  execution 
of  complex  pattern  generation.  In  view  of  this  we  may  conceive  of  predic¬ 
tive  tracking  as  involving  neuromuscular  following,  not  of  the  immediate 
sensory  input,  but  rather  of  a  cortically  generated  signal  which  is  perhaps 
only  intermittently  compared  with  the  direct  sensory  input. 

While  conceivably  the  ability  of  the  cortex  to  generate  signals  may 
be  unlimited,  it  is  clearly  capable  of  generating  linear  and  sinusoidal 
signals.  On  the  other  hand,  certainly  in  humans  the  nature  of  the  cortex 
is  revealed  in  terms  of  its  ability  to  generate  symbolic  patterns,  e.g., 
those  associated  with  speech  production.  This  might  be  considered  a 
special  case  of  neuromuscular  tracking  of  an  internally  generated  "auditory" 
signal.  The  number  of  basic  motor  pattern  elements  available  for  this  task 
is  not  clear,  but  apparently  it  is  finite  and  a  function  of  the  particular 
language.  There  is  now  some  evidence  that  the  continuous  "predictive  mode" 
output  involved  in  speech  involves  sequential  synthesis  of  blocks  of  out¬ 
put  of  syllable  length,  i.e.,  in  blocks  of  output  requiring  about  200  ms  of 
activity  (Ref.  11 T )  -  This  is  also  approximately  the  period  required,  in 
certain  eye  movement  studies,  before  additional  visual  information  is  pro¬ 
cessed  (Ref.  2b)  •,  and  also  correlates  with  the  minimum  period  for  attention- 
switching  from  one  modality  to  another,  and  appears  to  be  the  minimum  period 
required  for  a  reaction  time  task  and  for  alternation  of  repetitive  motor 
activity.  One  model  has  been  proposed  in  which  these  blocks  are  called  up 


and  sequenced  by  the  cortex,  and  then  transferred  to  subcortical 
centers  prior  to  execution  while  the  next  block  is  being  assembled 
cortically  (Ref.  117)- 

In  short,  what  Is  being  suggested  here  is  that,  while  a  considerable 
number  of  skilled  or  stereotyped  movement  patterns  and  even  the  capacity 
to  track  may  be  potentially  available  at  a  subcortical  level,  the  more 
complex  patterns  may  be  generated  in  the  cortex.  The  subcortical  patterns 
may  be  triggered  or  suppressed  by  the. cortex,  in  which  case  the  function 
of  the  cortex  might  be  the  execution  of  complex  data -processing  operations 
and  operations  of  a  logical  character.  These  would  include,  among  others, 
the  following  kinds  of  functions  which  are  presently  recognized  by  neuro¬ 
physiologists  as  involving  higher  neuronal  centers: 

•  Pattern  recognition  involving  space  and  time 

•  Attention,*  input  channel  selection  and  switching,  arousal 

•  Detection 

•  Output  mode  selection,  including  rapid  modification  of 
subcortical  and  spinal  circuits 

•  Symbolic  referencing 

•  Prediction 

•  Time  estimation 

These  functions,  in  man,  actually  occupy  the  sphere  of  activity  called 
"consciousness."  They  are  not  at  all  well  developed  in  other  animals.** 

2.  Timing  Relations  In  Supraspinal  Control 

When  the  coztex  is  involved  in  the  elaboration  of  a  motor  response, 
we  have  only  scanty  amounts  of  information  about  the  way  it  participates. 
Most  of  this,  in  fact,  only  gives  us  some  clues  as  to  the  timing  sequence 
involved . 


*There  is  some  evidence  that  "attention- switching"  nay  require  intact 
loops  to  the  cerebellum. 

**For  example,  in  the  monkey  there  is  no  evidence  of  any  predictive 
ability  in  eye  movement  control  when  tracking  a  periodically  moving 
target  (Ref.  1  1 8 )  .  .  * 
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In  a  recently  reported  series  of  experiments ,  monkeys  were  conditioned 
by  standard  operant  techniques  to  perform  some  simple  manual  responses 
such  as  lever-pushing  for  a  food-reward  when  presented  with  a  particular 
visual  stimulus  (Ref.  86).  Single  neurons  in  the  motor  cortex  with  axons 
in  the  pyramidal  tract  were  observed  before  and  during  the  presentation 
of  the  stimulus  and  the  subsequent  motor  response.  It  was  found  that  those 
units  which  showed  a  change  in  firing  pattern  prior  to  the  hand  movement 
showed  it  only  in  response  to  a  visual  stimulus  when  the  hand  movement 
followed,  i.e.,  cells  responded  if  and  only  if  the  stimulus  succeeded  in 
eliciting  the  conditioned  response.  Apparently  the  decision  process  occurs 
not  later  than  this  stage  and  very  likely  occurs  earlier. 

For  these  neurons  there  was  a  high  correlation  between  the  latency  of 
the  cell  response  and  the  latency  of  the  motor  response  as  measured  by  the 
EMG  or  total  reaction  time.  The  minimum  latency  of  these  cells  to  a  light 
flash  was  100  ms,  corresponding  to  a  total  reaction  time  of  180  ms,  which 
is  quite  :!Vort  for  a  monkey  (whose  usual  response  time  is  between  275  ms 
and  400  ms).  Thus  an  observed  minimum  response  latency  of  a  cortical  cell, 
in  response  to  a  light  flash,  might  be  120  ms;  the  EMG  latency  (of  the 
contralateral  hand)  might  be  1 70  ms,  and  the  reaction  time  220  ms. 

Similar  reaction  time  experiments  have  been  performed  with  humans  in 
which  the  latency  (response  delay)  of  the  visual  cortex  to  the .visual 
stimulus  was  measured  (by  means  of  the  characteristic  wave  which  appears 
in  the  EEG  recorded  ever  the  visual  areas).  Also  measured  was  the  total 
time  from  the  stimulus  onset  to  the  beginning  of  the  peripheral  EMI  response. 
Corresponding  to  the  time  of  onset  of  activity  in  pyramidal  tract  cells  of 
the  motor  cortex,  there  appears  in  the  motor  area  EEG  a  recognizable  wave 
which  has  beer,  termed  the  "motor  potential"  (Refs.  119,  120).  This  appears 
only  when  a  voluntary  motor  response  is  actually  cade.  It  appears  50-150  ins 
prior  to  first  sign  of  motor  activity  in  the  limbs,  and  reaches  a  peak  during 
maximum  muscle  activity.  From  the  evidence  presented,  we  can  construct  a 
rough  timing  diagram  of  the  sequence  of  events  following  a  conditional 
stimulus  and  leading  to  a  motor  response  (see  Fig.  46).* 

*There  is  considerable  evidence  also  that  the  total  reaction  time  may 
vary  by  5-10  ms,  depending  on  the  phase  of  the  alpha  rhythm  of  the  REG 
at  which  the  stimulus  is  presented  (Ref.  111). 
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Note :  The  movement  latency  which  is  the  time  derived  to  take  up  the 
slack  in  muscle  and  tendon  depends  on  the  initial  tension 
and  slacking  angle  of  the  limbs  (Ref.  122) 
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irr.ing  Diagram  of  Events  Related  to  f’ortica.l  Decision  and  Motor  Response  Task 


In  this  section  we  have  summarized,  experimental  results  from 
several  areas  of  neurophysiology  which  may  be  helpful  in  suggesting 
prototypes  of  brain  organization  that  underly  adaptive  behavior  in 
the  human.  While  the  examples  chosen  may  indicate  the  limited  and 
tentative  character  of  even  the  most  sophisticated  conclusions  available 
from  the  physiological  laboratory,  they  have  been  offered  in  the  convic¬ 
tion  that  as  models  they  are  indispensable  to  the  further  thinking  and 
experimentation  of  the  engineer  who  wishes  to  understand  and  interpret 
overall  behavior  in  terms  of  the  unitary  elements  of  the  neuromuscular 
system  and  the  brain.  In  this  respect,  the  necessity  of  the  engineer 
to  study  the  models  of  the  physiologist  mirrors  the  growing  awareness 
on  the  part  of  the  physiologist  that  systems  engineering  concepts  end 
models  and  studies  of  adaptive  motor  performance  in  humans  can  provide 
key  insights  into  the  often  intractable  complexities  of  brain  structures 
and  components .  The  present  chapter  clearly  reflects  the  mutual  influence 
of  these  two  disciplines  and,  we  believe,  offers  a  real  basis  for  the 
optimistic  view  that  the  world  of  macroscopic  observation  of  human  per¬ 
formance  and  the  microscopic  world  of  the  neurophysiologist  can  be 
unified.  The  connecting  link  is  tV.  constraint  that  appropriate 
ensembles  of  microscopic  elements  must  yield  behavior  that  can  explain 
macroscopic  performance • 


SUCTION  VIII 

A  SIMPLE  TEST  FOR  OPTIMALITY 


A-  INTRODUCTION 

This  section  and  Section  DC  describe  methods  for  determining  the 
quantities  which  may  be  minimized  by  the  human  operator  in  tracking  tasks, 
i.e.,  his  criteria  for  optimality.  Only  quadratic  criteria  are  considered. 
As  explained  in  Ref.  123,  optimality  with  respect  to  such  criteria  implies 
optimality  with  respect  to  many  other  criteria  for  systems  forced  by  sta¬ 
tionary  random -appearing  Gaussian  inputs.  The  present  section  describes 
a  simple  test  for  optimality  which  requires  only  information  about  the 
mean-squared  values  of  input  signal,  controller  response,  system  response, 
and  system  error,  where  "error”  is  defined  as  the  difference  between  the 
actual  system  response  and  a  "desired"  response.  The  desired  response  is 
identical  to  the  input  signal  in  the  tracking  tasks  considered  here.  The 
test  yields  a  quadratic  criterion  for  which  the  describing  function  is 
optimal;  but  it  does  not  give  the  describing  function  of  the  optimum 
system  in  literal  or  numerical  terms. 

Section  IX  uses  a  more  complicated  procedure  to  identify  not  only  the 
criterion,  but  also  the  optimal  describing  function.  The  criterion  is 
further  generalized  to  include  cross-product  terms. 

These  sections  represent  two  different  (but  by  no  means  mutually 
exclusive)  ways  of  solving  essentially  the  same  problem.  Future  progress 
in  the  quest  for  human  operator  optimization  criteria  may  well  involve  & 
combination  of  both  approaches.  It  is  therefore  important  that  projected 
measurement  programs  take  into  account  the  data  requirements  for  the 
application  of  each  technique. 

B*  THE  TEST  FOR  OPTIMALITY 

This  subsection  describes  a  simple  test  for  optimality,  applicable  to 
systems  forced  by  stationary  random  inputs,  o.g.,  the*  human  operator  in 
some  tracking  tasks.  The  test  has  the  advantage  that  it  does  not  require 
calculation  of  the  describing* function  of  the  system. 


If  the  system  satisfies  the  criterion 
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Minimum  (e2  +  kc2) 

where  k  is  a  constant,  e  is  the  difference  between  the  desired  response, 
n^,  and  the  actual  system  response,  m,  and  c  is  the  controller  output  as 
in  Fig.  47,  with  the  wavy  bars  denoting  averaged  values,  then  the  follow¬ 
ing  relationship  is  satisfied: 

e2  =  m§  -  m2  -  2kc2  ( 1+6) 

A  proof  is  given  in  the  appendix.  For  k  =  0  (the  Wiener  system),  proofs 
have  been  given  by  Lee  (Ref.  124)  and  others. 

1  •  Application  of  the  Teat 

We  shall  illustrate  the  application  of  Eq.  46  to  human  pilot  behavior 
in  both  pursuit  and  compensatory  tracking  tasks  with  a  stationary  random 
forcing  function.  In  tracking  tasks  the  desired  response,  md,  is  equal 
to  the  input  signal  i,  hence  in  Fig.  47,  F-|  =  1  Because  Eq.  46  does 
not  require  any  information  regarding  the  system  structure  other  than 
the  transfer  function  of  the  controlled  element,  it  is  not  necessary  to 
specify  the  feedbacks  used  by  the  pilot.  Thus  in  Fig.  47,  HJ  represents 


"The  notation  of  Fig.  4'/  is  explained  in  the  appendix. 
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the  transfer  function  of  an  equivalent  series  controller  which  produces 
the  same  <t>ic  cross  spectrum  as  the  human  pilot,  given  the  san.e  input 
signal,  i,  and  uncorrelated  noise,  n^,  the  latter  representing  the  rem¬ 
nant.  Figure  47  therefore  can  represent  either  pursuit  or  compensatory- 
tracking  . 

In  Fig.  47  the  remnant,  r^,  ha3  been  referred  to  the  input.  This  is 
purely  for  convenience;  Eq.  46  is  not  affected  by  the  choice  of  injection 
point  for  the  remnant. 

The  derivation  of  Eq.  46  assumes  that  both  i  and  nf  are  stationary. 
This  condition  may  be  only  approximately  satisfied  in  actual  tracking 
tests.  The  proportion  of  the  remnant  that  is  stationary  depends  on  the 
controlled  element.  For  pure  'gain  controlled  elements  (as  in  the  tests 
described  below)  Ref.  18  concludes  that  the  . emnant  is  mainly  composed 
of  stationary  noise. 

The  data  graphed  in  Fig.  48  are  taken  from  tests  (Ref.  18)  on  a  human 
operator  tracking  a  series  of  inputs  generated  by  randomly  phased  sine 
waves  to  approximate  a  stationary  random  Gaussian  signal  with  an  aug¬ 
mented  rectangular  spectrum.  One  set  of  inputs  was  identical  to  those 
of  Ref.  12  with  ten  component  frequencies.  The  amplitudes  of  the  lowest 
six,  seven,  or  eight  frequencies  were  set  equal,  for  cutoff  frequencies 
designated  as  =  1 .5,  2.5,  and  4.0  rad/sec,  respectively,  in  Fig.  48. 
The  amplitudes  of  the  frequencies  greater  than  were  set  to  one -tenth 
of  that  of  the  low  frequencies.  TVk  input  designated  Rl4  comprised  ten 
equal -amplitude  sine  waves  with  frequencies  ranging  from  0.514  to 
14.03  rad/sec.  The  B5  input  was  similar,  except  that  the  four  highest 
frequencies  (starting  at  4,2-  rad/sec)  were  attenuated  10  db.  The  rms 
value  of  each  input  was  1  in.  deflection  on  the  CRT  display.  For  the 
tracking  task  these  inputs  were  equal  to  the  "desired  response,”  m^. 

The  data  given  in  Ref.  1 8  include  mean-squared  values  of  e-  jn  display 
inches  and  c  in  degrees  of  stick  deflection,  but  not  m.  Howr?ver,  for  the 
case  when  the  controlled  element  was  a  pure  gain  it  is  easy  to  obtain  m, 
using  m  Kce,  where  Kc  ^  I  in.  display  per  6°  stick. 


Figure  48  illustrates  e2,/i2  graphed  against  nf/i2.  It  it;  see 
measured  performance  is  close  to  optimum  in  the  Wiener  sense,  i.e.  . 

(The  term  "close"  is  defined  more  precisely  below.) 

The  most  significant  and  interesting  region  of  Fig.  48  from  the  stand- 
point  of  criteria  is  the  "knee"  of  the  graph  where  e2/!^  is  relatively 
large,  e.g.,  greater  than  0.10.  As  we  shall  show  shortly,  in  this  region 
the  Wiener  system  is  quite  critically  defined  (as  opposed  to  the  region 
where  e2/i2  is  small,  where  almost  any  reasonable  system  can  closely 
approach  the  Wiener  performance).  Figure  48  also  illustrates  Eq.  46 
graphed  for  k  =  0.1  and  -0.1.  To  achieve  the  most  compact  presentation, 
k  has  been  made  dimensionless  by  normalizing  c  such  that  for  the  pure  gain 
controlled  element  considered  here,  Yc  = Kc  -  1 .  That  is,  the  units  of  c 
have  been  referred  to  the  displacement  of  m  observed  at  the  display.  To 
make  this  clear,  consider  the  criterion 


Minimum  (e2  +  kc2) 


k  -  1  implies  that  equal  weight  is  attached  to  mean-squared  values  of  e  of 
1  in. ^  (l  in.  difference  between  1  and  m  on  the  display)  and  to  mean- 
squared  values  of  c  equal  to  the  square  of  the  steady-state  value  of  c 
that  would  produce  a  steady  deflection  of  1  in.  at  the  m  display. 

The  foregoing  discussion  will  be  extended  later  when  -e  consider 
controlled  elements  having  dimensions  which  involve  time,  e.g.,  K/s  and 
K/s2.  With  k  normalized  as  indicated  above,  Yc  =1  for  the  data  of  Fig.  48, 
c  -m,  and  hence  k  can  be  found  (see  Table  XIV)  from  Eq.  4”  modified  for  c  -  m 


as  follows : 


%  -  1  -  0  +  2k)  % 

l2  i 2 


Because  of  the  limited  accuracy  of  t.he  data  measurement  and  reduction, 
the  calculation  of  k  to  an  accuracy  closer  than  about,  *0.04  it;  not  mean¬ 
ingful.  Within  this  restriction,  it  appears  that  for  compensatory  displays 
the  human  operator  is  essentially  optimal  in  the  Wiener  sense  lor  the  pure 
gain  controlled  element  Kc  -  1  .  The  pursuit  data  show  a  small  but  definite 
tendency  for  negative  k. 


TABLE  XTV 


COMPUTATION  OF  k  FOR  PURE  GAIN  CONTROLLED  ELEMENT,  Yc  =  1 
(Data  graphed  in  Fig.  46 ) 


|  INDIVIDUAL  RUNS  "  ’  | 

Input 

Display 

e2,/i2 

_  n 

1  -  e2/t£ 

S/i? 

k 

R1  4 

c 

0.66 

0.55 

0.295 

+0.097 

R1  4 

P 

0.675 

6-525 

0.415 

-0.11 

B5 

c 

0.24 

O.76 

0.71 

+0.055 

B5 

p 

0.285 

0.715 

0.86 

-0.085 

o>i  =  4.0 

c 

0.08 

0.92 

1 .04 

-0.0575 

=  4.0 

p 

0.122 

O.878 

0.97 

-0.0475 

csi  =2.6 

c 

0.05 

0-95 

0.97 

-0.01 

a*  =  2.5 

p 

0.0,522 

0 . 9668 

1  .14 

-0.075 

o>l  =  1  .5 

c 

0.0415 

0.9585 

1  .02 

-0.05 

CO  =1.5 

p 

0.02% 

a. 9765 

Lit 

-0.07 

r”~  AVERAGED  RESULTS  "“““H 

Display 

Mean  k 

RMS  Deviation 

Mean  Absolute 
Deviation 

Pursuit 

-0.0775 

0.021 

0.016 

Compensatory 

+0.0069 

0.054 

0.0471 

2.  Th*  Use  and  Interpretation  of  the  fast  Results 

The  formula  for  the  optinrum  transfer  function  is  derived  assuming  that 
the  signal  and  remnant  are  unaffected  by  small  variations  from  the  optimum 
transfer  function.  This  assumption  is  supported  by  the  experimental  data 
of  Refs.  18  and  126  which  show  that  for  pure  gain  controlled  elements  the 
remnant  referred  to  the  pilot's  input  varies  very  little  with  signal  band¬ 
width  and  amplitude.  (The  test  equation,  Eq.  46,  holds  provided  the  remnant 
is  constant,  ii respective  of  whether  it  is  referred  to  i,  c,  or  m. ) 

The  results  can  therefore  be  used  to  estimate  the  human  pilot  describing 
function  by  calculating  the  minimum  (e^+kc^)  system,  the  transfer  function 
of  which  it  ^iven  at  the  beginning  of  the  Appendix  (Eq.  A-l ) .  The  data 
required  are: 
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•  An  expression  for  the  nonmlnimum  phase  part  of  the  human 
operator  describing  function ,  associated  with  his  time 
delay,  t,  assumed  to  be  invariant  with  the  remainder  of 
his  describing  function,  and  usually  represented  by  a 
Fade  approximation. 

•  The  spectrum  of  the  tracking  signal  expressed  as  (or  approxi¬ 
mated  by)  an  algebraic  function  of  (jco)  which  is  factorable 
in  the  Wiener- Hopf  sense. 

•  The  spectrum  of  the  remnant,  similarly  expressed.  (To  use 
Eq.  A-1  directly  the  remnant  should  be  referred  to  the 
signal,  i,  but  Eq.  A-1  can  be  reformulated  if  it  is  more 
convenient  to  refer  the  remnant  to  c  or  m.) 

The  interpretation  of  the  value  of  k  requires  care .  For  k  =  0  the  part 
of  the  pilot's  output  linearly  correlated  with  i  certainly  minimizes  €2. 

But  we  cannot  conclude  that  the  pilot  as  a  whole  is  minimizing  e2  because 
a  smaller  value  of  €2  would  certainly  be  attained  if  he  retained  the  same 
describing  function  but  eliminated  his  remnant.  Only  if  we  regard  <Dnrii  as 
fixed  (an  assumption  which,  as  noted  above,  is  realistic  for  the  Yc  =  Kc 
data  of  Refs.  12  and  18,  where  $>nni  =  because  of  the  compensatory 

display)  can  we  claim  that  the  pilot  as  a  whole  is  minimizing  e2.  Note 
that  the  instructions  given  to  the  pilot  state  that  he  is  to  "move  the 
stick  to  keep  the  error  small."  Since  for  Gaussian  inputs  this  is  eauiva- 

mV 

lent  to  demanding  minimum  e2  (see  p.  27  of  Ref.  125),  ve  should  expect 
experimental  results  to  indicate  a  value  of  k  close  to  zero.  Reference  126 

AW  rtW 

describes  experiments  in  which  a  pilot  was  instructed  to  minimize  e2  +  kc2. 
His  behavior  varied  with  the  value  of  k.  Unfortunately,  m2  data  are  not 
obtainable  for  the  tests  of  Ref.  126,  and  Eq.  46  therefore  cannot  be  applied 
to  check  the  actual  value  of  k  against  that  used  in  the  instructions. 

For  k  >  0  the  argument  of  the  preceding  paragraph  can  be  repeated, 
replacing  e2  by  e2  +  kc2.  Similar  considerations  apply  for  k  <  0,  but  it 
must  be  noted  that  large  negative  values  of  k  are  inadmissible  because  of 
stability  limitations  on  the  optimum  system  transfer  function.  These 
restrict  |k|  for  k  <  0  to  the  value  that  would  cause  the  optimum  system 
transfer  function  (Eq.  A-1 )  to  be  unstable. 
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3*  Sensitivity  of  the  Test 

The  sensitivity  of  the  test  formula  has  been  investigated  by  applying 
it  to  two  series  of  systems,  one  optimal  in  the  Wiener  Sense  (k  =  0)  and 
the  other  deliberately  constructed  to  be  nonoptimal  for  k  =  0. 

The  input  signal  spectrum  assumed  is  4^  =  I/O  +  u£),  the  noise 
(remnant)  spectrum  is  $nn^  =  a2/(l  +  a£/l00),  and  the  desired  response, 
m^,  is  equal  to  the  signal.  Both  signal  and  noise  enter  at  the  same 
point,  as  in  Pig.  47.  The  parameter  a  is  the  ratio  of  the  dc  levels  of 
noise  to  signal.  The  nonoptimal  systems  were  produced  by  modifying  the 
Wiener  system  transfer  function,  which  is  calculated  in  Ref.  127  as 

H(jcn)  =  - 

1  +  a2  + 

The  nonoptimal  systems  have  the  same  gain,  but  no  equalization,  i.e.,  the 
transfer  function  is 

11 

m 


Figure  49  compares  the  Wiener  and  nonoptimal  systems.  For  the  test  to  be 
of  practical  value,  the  graph  of  e2/i2  versus  m2/!2  of  the  nonoptimal  system 
should  depart  appreciably  from  the  graph  of  the  test  formula.  As  shown  in 
Figure  49,  for  c2/i2  >  0.1  the  graphs  become  quite  dissimilar,  and  there 
is  a  wide  spread  in  the  location  of  points  on  each  graph  corresponding  to 
a  given  noise/signal  ratio.  Of  course  only  one  range  of  nonoptimal  systems 
has  been  tested  here,  and  there  is  no  limit  to  the  number  that  could  be 
examined.  However,  Fig.  49  does  provide  at  leart  a  preliminary  indication 
that  the  test  formula  is  of  adequate  sensitivity  in  the  interesting  region, 
where  even  for  the  optimum  system  e2/i2  >  1 . 

\ 


H(j<n)nonopt  = 


1  +a2  +y(l+a2)(a2  +  1l0~) 
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0.  APf LEGATION  ON  TUB  TMT  TO  Kg/*  AIO  Kg/a®  OOIfWOLLSD  BUMUffN 


l'i  llilii  mibnect  lui>  w*»  d*»«orlb»  (li#  application  of'  Fq.  ).<•  lo  tracking 
U\ ii h n  using  emit  roii*ii  niwmpmp  of'  (lie  following  forms : 

\  *■  K^. ;  S 

Y0  -  K0/»;1 

Thrse  data  war*  taken  from  H«f.  16,  The  operator  wim  the  as  Umt.  for 

the  Y0  •  d« tA i  a  )>1  lv>t  with  iightplan*  experience  only.  An  with  the 

**■> 

previously  examined  testa  on  Y^-Kg,  values  of  nr  were  not  recorded.  Heonui't 
of  t he  more  comp l lea t *»d  nature  of  the  oont.ro lied  element n ,  there  In  no  wny 
to  deduce  mfc>  knowing  only  c*-,  and  i*\  It.  was  therefore  neeemmo’  t*0 
rerun  the  mpeu  of  i,  « ,  o,  and  m  which  were  taken  during  the  tent, a  of  Ref.  1 
Uoitm  discrepancies  were  noted  between  the  rerun  and  original  data,  and  the 
renultn  on  K0/@  and  controller  elements  muat,  therefore  be  regarded 

an  provisional. 

1 .  Result* 

The  reduced  data  are  listed  in  Table  XV.  Appropriate  experimentally 

obtained  values  of  c4-/!*-  are  graphed  versus  in  Fig.  ‘>0 .  Note  that 

-of 

due  to  difficulties  with  the  tape  readout  equipment,  o4-  was  not,  available 
on  all  runs.  Consequently,  k  could  not  be  calculated  via  Eq.  4b  for  a.ll 
runs . 


8.  Interpretation  of  Reeulte 


Figure  90  shows  that  the  data  points  do  not,  in  general ,  satisfy  the 

MW  aA*  MjW  '  — 

relationship  ..  l^-m4-.  Thus  the  system  1b  not  tending  towards  the 
Wiener  optimum.  The  values  of  k  required  to  fit  the  more  general  equation 
c2  K  t*--ni2-2kc2  have  been  calculated  where  possible,  and  are  listed  In 
the  right  column  of  Table  XV.  For  Yc  =  5/s^,  the  k's  for  compensatory 
tracking  were  -0.107,  and  -0.102,  -O.IOB,  and  -0.0932  (mean  k  =  -0.1027); 
for  pursuit,  -0.0748  and  --0.0689  (mean  k  =  -0.7>7)«  The  overall  mean  is 
k  *  -0.0907* 

Figure  51  is  a  "carpet"  Illustrating  the  deviation  of  the  experimental 
results  from  the  formula  j^-m2-2kc^  with  k  -  -0.09  sec4  for  Yc  =  !?/s^* 


132 


taiuj*:  XV 


«$,  n?,  AND  P  DATA 


RUN  NO. 

g 

1* 

B 

B 

k 

i 

042864-1 

0 

0.268 

0.03'» 

0.346 

0.743 

0.2<8i 

1  .  54 

2 .  Pvt 

-0. 0**32  sec4 

«: 

042864-2 

H 

0.264 

0.0423 

0.343 

0.37 

0.1 61 

1 . 31 

. .  J 

2.16 

-0. 1 08  sec4 

5 

042764-1'> 

± 

b 

c 

0.4V  i 

0.0743 

0.288 

N.A. 

0.288 

1  .11 

N.A. 

N.A. 

a 

042764-1 6 

± 

a 

1 

0.253 

0. 03**2 

0.24o 

N.A. 

0.233 

0.95 

N.A. 

N.A. 

5 

042764-17 

j. 

Q 

p 

0.2463 

oO 

0 

0 

0.210 

N.A. 

0.239 

O.85 

N.A. 

N.A. 

6 

042764-1 S 

8 

p 

0.2415 

0.0638 

0.2,32 

N.A. 

0.263 

O.96 

N.A. 

N.A. 

B 

04 3063-5 

| 

c 

0.2415 

0.04y 

o.2ce 

1.5 

1  . 91 

—0. 1  31  sec^ 

a 

042964-2 

4 

6‘ 

c 

0.25 

0.206 

0.51 

2.2 

0.824 

2.04 

8.7 

( 

-0.107  sec4 

9 

042964-3 

JL 

S2 

c 

0.25 

0.1  94 

0.49 

2.12 

0.775 

1  . 96 

8.49 

-0.102  sec4 

10 

042y64-4 

JL 

s? 

p 

0.25 

0.154 

0.364 

1  -79 

0.615 

1  .46 

7.16 

-0.074  8  nee4 

n 

042964-5 

± 

p 

0.25 

0.1 32 

0.28 

1  .18 

0.523 

1.12 

4.71 

-O.O6183  sec4 

The  dimensions  of  i,  €,  and  m  are  inches  of  deflection  on  the  scope. 

The  scale  of  c  is  adjusted  to  be  the  same  as  the  scale  of  m  for 

Yc  -  1 •  Note  that  the  dimensions  of  k  equal  the  dimensions  of  |yc|^. 
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1.0 


3.0 


mi 

1* 


Mean-Squared  Error 
.n-Squared  Output 


(This  k  represents  a  rounded-off  value  of  the  above  mean  k;  with  these 
data,  accuracy  of  more  than  one  significant  figure  in  the  determination 
of  k  should  not  be  expected.)  The  "carpet"  may  be  regarded  as  a  projec¬ 
tion  of  the  three-dimensional  graph  of  e2/i2  *  1-  (m2/i2)  +  0.l8(c2/i2) 
with  the  m2/i2  and  c2/ i2  axes  projected  to  match  the  horizontal  scales 

AAA.  «*»«*»■ 

shown,  and  the  e2/i2  vertical  scale.  The  advantage  of  this  form  of 
presentation  is  that  it  permits  linear  interpolation  between  the  lines 
of  constant  m2/i2  and  constant  c2/i2.  For  the  m2/i2  and  c2/i2  scales 
to  be  applicable,  such  interpolation  must  be  made  horizontally. 

The  length  of  each  arrow  on  Fig.  51  indicates  the  divergence  of  the 
appropriate  experimental  data  point  from  the  formula 

e2/i2  =  1  -  (m2/i2)  +  0.l8(c2/i2) 

for  the  controlled  element  Yc  *  5/s2.  It  is  logical  to  inquire  how  the 
previously  obtained  data  for  Yc  =  1  would  fit  this  formula.  For  this 
simple  controlled  element,  c  =  m  and  the  fit  could  be  demonstrated  by 
drawing  an  additional  line  in  Fig.  48  corresponding  to  k  =  -0.09. 

However,  to  obtain  a  more  direct  comparison  with  the  Kc/s2  data.  Fig.  52 
has  been  prepared.  This  is  an  extension  of  Fig.  51  showing  the  points 
graphed  on  Fig.  48  that  correspond  to  the  higher  bandwidth  inputs  Rl4, 

B5,  and  =  4.  Note  that  the  deviation  from  the  formula  is  of  the  same 
order  as  the  deviation  in  e2/i2  due  to  uncertainties  in  the  measurement 
of  this  quantity,  and  m2/i2.  For  example,  in  Fig.  48,  for  the  R1 4  com- 
pensatory  case,  nr/ i2  lies  between  0.25  and  0.58*  Thus,  in  Fig.  52, 

ywxv  aaa. 

m2/i2  and  hence  c2/i2  lies  within  an  "ellipse  of  uncertainty"  on 
the  m^/i2,  c2/i2  plane,  as  shown.  From  Fig.  48,  e2/i2  for  this 
point  is  between  0.62  and  0.67.  The  area  between  these  two  levels 
is  shaded  in  Fig.  52.  Note  that  this  area  almost  intersects  the  ellipse 
of  uncertainty.  This  indicates  that  the  deviation  of  the  experimental 
data  point  from  the  formula  only  slightly  exceeds  the  deviation  that 
would  be  expected  due  to  the  uncertainties  in  data  measurement. 

As  with  the  Yc  *  Kc  data,  it  is  necessary  to  assume  that  the  spectrum 
of  the  remnant  referred  to  the  input  is  constant  for  the  test  tc  be  a  valid 
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indication  that  the  pilot  is  minimizing  e2  +  kc2.  The  experimental  remnant 
data  of  Fig.  6l  of  Ref.  12  indicate  that  the  variation  of  't'nne  is 

slight.  Quoting  Ref.  12,  "...the  spread  present  is  probably  as  indicative 
of  run-to-run  variability  as  it  is  of  any  G>rme  dependence  on  forcing  func¬ 
tion  bandwidth."  Figure  64  of  Ref.  12  shows  a  similarly  small  variation  of 
fl>pnc  with  large  changes  in  controlled  elements.  Reference  12  concludes, 
"...the  major  effect  of  (controlled  element)  variation  on  the  remnant  is  as 
much  intersubject  as  inter-controlled-element. "  Thus  it  is  concluded  that 
with  controlled  elements  of  the  form  Kq/s^  the  human  operator  acts  in  such  a 
fashion  that  e2  +  kc2  is  minimized,  where  k  is  about  -0.09  sec1*. 

D.  APPLICATION  0 T  THE  TEST  TO  LONGITUDINAL  SHORT-PERIOD  CONTROL 

Reference  128  describes  fixed-base  simulator  compensatory  tracking  tests 
in  which  the  pilot  was  required  to  track  a  commanded  random-appearing  pitch 
angle.  This  was  the  sole  input  and  was  intended  to  represent  target  motion. 
The  input  was  generated  by  sums  of  randomly  phased  sine  waves  such  that  the 
spectrum  was  essentially  flat,  extending  from  to  =  0.157  to  co  =  1  rad/sec, 
with  a  high  frequency  shelf  from  cu  =  1  to  u>  =  1  1  rad/sec.  The  run  length 
was  4  min.  The  transfer  function  of  the  controlled  element  was 


M6(s  +  0.585) 

s[s2  +  2(0. 397)  (0. 764)s+  (0. 764)2 


The  data  required  for  the  test  formula. 


1  *  fr  ~ 2k 
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are  tabulated  in  Table  XVI . 


TABLE  XVI 

VALUES  OF  k  FOR  LONGITUDINAL  SHORT -PERIOD  CONTROL 


PILOT 

RUN  NO. 

i2 

e2 

m2 

c2 

k 

(sec^ ) 

(ej2 

deg2 

{e^ey2 

deg2 

©2 

deg2 

( 6M5 ) 2 
(deg/sec)2 

1 

670127-15 

4,64 

0.80 

6.00 

59-1 

-0.0279 

67O127-I  6 

4.61 

O.96 

6. 1 4  1 

25.2 

... 

-0.0496 

670127-17 

4.81 

! 

0.98 

6.40 

38.7 

-0.0332 

B 

670202-16 

4.15 

0.?14 

5 . 29 

I8.7 

-0.04-5 

670202-17 

4.19 

0.769 

5-31 

0 

CC 

670202-18 

4.27 

0.717 

1 

. 

1 

5.56 

1 

21 .5 

— 0 . 046o 

Both  operators  were  highly  experienced  commercial  pilots.  It  is 
noteworthy  that  Pilot  B  obtained  the  lower  7^,  despite  the  fact  that  his 
|k|  was  farther  removed  from  zero.  This  implies  that  his  remnant  power 
referred  to  his  output,  m^,  must  be  lower.  This  is  confi  rmed  by  exami¬ 
nation  of  the  $nrie  spectra  which  show  very  little  variation  from  run  to 
run,  but  indicate  a  difference  between  the  pilots'  ,  which  is  about 

6  db  lower  for  Pilot  B  at  frequencies  above  about  25  rad/sec.  The 
spectra  for  both  pilots  were  closely  similar  at  lower  frequencies. 

1.  ItMfMK  07  mUZ/Tf  TOR  ALL  G0HR0LUQD  I  LEMUR'S 

The  mean  values  for  the  constant  In  the  performance  criterion  ar<- 


summarized  irt  Table  XVII. 


TABLE  XVII 

MEAN  EXPERIMENTAL  VALUES  OF  k 


CONTROLLED 

EIjEMENT 

Yc 

PURSUIT 

COMPENSATORY 

Mean 

Average  Deviation 

Mean 

Average  Deviation 

rms 

Absolute 

rms 

Absolute 

1 

-0.0775 

0.021 

0.016 

+O.OO69 

0.054 

0.0471 

5/s2 

-0.0717  sec4 

0.0032 

0.0031 

-0.1027  sec4 

0.00586 

0.00496 

i/s 

-0.131  sec2 

One  run  only 

— 

— 

Pilot  A 

(e/»>.p 

-0.0369  sec4 

0.00917 

0.00843 

1 

Pilot  B 

(s/8>8p 

-O.OI+98  Bec^ 

1 

0.00238 

0.00203 

7.  OOSCLUSIO* 

Systems  forced  by  stationary  random  inputs  may  be  tested  for  optimality 
with  respect  to  the  criterion  of  minimum  (e2  +  kc2)  by  applying  the  follow¬ 
ing  formula  (Eq.  46) : 

e2  =  -  m^  -  2kc2 


where 


m^  ■-  the  desired  system  response 
m  -  the  actual  system  response 
c  =  the  controller  output 
e  -  m  -  ny 


The  derivation  of  Eq.  46  assumes  that  the  system  Is  forced  by  a  signal  and 
noise,  both  of  which  (l)  have  no  first-order  dependence  on  the  input,  and 


(2)  are  stationary  and  random.  The  application  of  Eq.  4b  to  tracking 
tests  involving  human  operators  requires  these  conditions  to  be  satis¬ 
fied  to  the  accuracy  compatible  with  the  inevitable  run-to-run  variations. 
In  this  regard  the  critical  input  component  is  the  remnant,  because  the 
forcing  function  is  controlled  to  be  random-appearing  and  stationary 
(within  the  limits  imposed  by  finite  run  length) .  For  pure  gain  con¬ 
trolled  elements  the  princi  1  component  of  the  remnant,  ®nne>  is  sta¬ 
tionary  noise,  which  shows  only  slight  variation  with  controlled  element 
gain.  For  other  controlled  elements,  nunstationary  transfer  effects 
appear  to  be  more  significant,  and  the  remnant  is  strongly  dependent  on 
the  controlled  element.  Reviewing  the  available  data  in  the  light  of 
the  above  considerations,  it  is  concluded  that  Eq.  46  should  be  used 
with  caution  unless  the  remnant  is  small  or  the  mean-squared  error  due 
to  nonstationary  effects  is  small  compared  to  that  due  to  the  stationary 
remnant  component  and  the  fixed  delays  of  the  human  operator. 

For  most  controlled  elements  small  negative  values  of  k  were  obtained 
(Table  XVII) .  The  k  values  deduced  from  the  Kc/s  and  Kc/s^  controlled 
elements  are  provisional  because  of  discrepancies  noted  in  the  experi¬ 
mental  data,  resulting  in  some  uncertainty  about  the  values  of  m^. 

The  consistent  trend  toward  negative  k,  and  the  invariance  of  the 
remnant  spectrum,  4>nn  ,  implies  that  the  pilot  could  achieve  a  smaller 

p 

mean-squared  tracking  error,  e  ,  if  he  was  less  eager  to  move  the  stick. 

It  may  therefore  be  worthwhile  conducting  further  investigations  to  see 
if  this  can  be  achieved  by  a  change  in  instructions  and/or  display.  The 
numerical  values  of  k  measured  in  units  of  seconds  vary  remarkably  little 
with  changes  in  controlled  element  However,  because  of  the  dimension¬ 
ality  of  k,  it  must  not  be  interpreted  as  a  "universal  constant"  valid 
for  all  controlled  elements. 


SECTION  IX 

IBS  INVERSE  OPTIMAL  CONTROL  APPROACH 


Currently  the  qua si- linear  human  pilot  describing  function  is  adapted 
to  a  given  controlled  element  by  using  verbal  adjustment  rules.  These 
require  a  certain  engineering  artistry  to  apply  effectively.  Interest  in 
the  inverse  optimal  control  problem  stems  from  a  desire  to  alleviate  this 
difficulty  by  obtaining  a  more  concise  mathematical  statement  of  these 
rules.  Identification  of  a  performance  index  which  represents  the  essen¬ 
tial  criterion  for  pilot  adaptation  would  provide  such  a  statement  of 
rules.  The  derived  performance  index  would  be  most  useful  if  it  had  some 
invariant  properties  for  a  broad  spectrum  of  controlled  elements,  but  even 
if  this  were  not  the  case  tne  indices  would  be  an  interesting  alternate 
means  for  considering  human  operation. 

A.  COMMENTS  ON  THE  INVERSE  OPTIMAL  CONTROL  PROBLEM 

Briefly,  the  inverse  optimal  control  problem  is  that  of  finding  the 
conditions  (or  performance  index)  tinder  which  a  Given  system  is  optimal. 
Kalman  considered  this  problem  at  length  in  Ref.  129.  In  development  of 
the  solution,  Kalman  uses  constraints  such  that  any  system  synthesized 
using  the  performance  index  found  from  the  inverse  problem  will  produce 
a  stable  system.  Stability  is  assured  via  Iyapunov's  Second  Method,  so 
the  constraints  are  sufficient  rather  than  necessary;  in  fact,  the  restric¬ 
tions  are  usually  overly  conservative.  In  that  case,  the  class  of  allowable 
optimal  systems  is  restricted  to  those  for  which  no  element  of  the  cost  is 
allowed  to  assume  negative  values.  This  restriction  affects  the  ability 
to  find  the  performance  index  for  many  stable  systems  which  are  otherwise 
optimal.  In  particular,  negative  values  of  some  terms  in  the  performance 
index  can  exist  for  some  stable  linear  constant-coefficient  regulator 
systems  yielding  good  performance.  Furthermore,  these  systems  have  a 
minimum  performance  measure  and  can  thus  be  considered  to  be  optimal  as 
long  as  the  cost  is  a  real  number. 

Obermayer  and  Muckier  (Ref.  1 50)  have  considered  applying  the  theory 
of  the  inverse  optimal  control  problem  to  identify  that  performance  index 


which  a  pilot  "must"  be  satisfying  in  a  given  continuous  compensatory 
control  task.  They  were  dissatisfied  with  their  results  largely  because 
negative  values  of  the  cost  were  a  distinct  possibility  in  a  large  number 
of  instances.  Reference  129  shows  that  second-order  optimal  control 
systems  with  positive  costs  of  the  form  k^  +  Xu2  (where  x  is  a  state  vari¬ 
able  and  u  the  control  variable)  tend  to  have  damping  ratios,  greater 
than  1  /V2\  Smaller  damping  ratios  can  result  from  performance  indices 
like  x2+ak^  +  Xu2,  where  a<  0,  thereby  contributing  a  negative  cost 
increment.  Now,  the  human  pilot  in  a  compensatory  tracking  system  behaves 
such  that  the  dominant  closed-loop  poles  of  the  closed-loop  describing 
function  for  the  system  have  damping  ratios  on  the  order  of  0.2.  Thus, 
those  factors  which  discouraged  Obermayer  and  Muckier  really  seem  to  indi¬ 
cate  that  the  overrestrictive  Lyapunov  sufficiency  condition  should  be 
replaced  by  a  necessary  and  sufficient  condition  on  the  performance  index 
for  stability  of  the  optimal  system.  The  question  of  stability  as  implied 
by  the  performance  index  will  not  be  a  prime  concern  here,  since  the 
stability  of  optimal  linear  constant-coefficient  systems  is  clearly  evident 
upon  solution  of  the  direct  problem.  Negative  cost  components  will  be 
allowed  in  the  following  analysis  without  immediate  regard  for  stability. 

Obermayer  and  Muckier  also  assumed  that  off-diagonal  terms  in  the 
performance  index  matrix  are  zero.  This  assumption  was  apparently  made  so 
that  numerical  solutions  for  the  remaining  coefH  cients  of  the  performance 
index  could  be  obtained  for  each  controlled  element.  This  approach  can  be 
made  more  general  if  the  off-diagonal  terms  in  the  performance  index  are  not 
arbitrarily  set  to  zero.  Then  a  single  performance  index  can  be  found  that 
is  invariant  for  several  different  controlled  elements.  If  the  "different 
controlled  elements"  are  chosen  to  span  the  spectrum  of  controlled  elements 
controllable  by  the  pilot,  then  it  seems  plausible  that  this  criterion 
would  apply  for  intermediate  controlled  elements  in  the  spectrum  also. 

The  foregoing  possibilities  are  explored  in  greater  detail  in  the 
following  discussion.  Considered  in  turn  are  the  use  of  time  domain  tech¬ 
niques,  the  use  of  frequency  domain  techniques  for  "discovering"  the  human 
pilot's  performance  index,  and  a  current  estimate  of  results  that  may  be 
obtained  through  these  techniques. 


B.  TIME  DOMfcH  TECHNIQUES 


Time  domain  techniques  appear  to  be  useful  in  the  current  context 
mainly  for  the  purpose  of  demonstrating  that  the  approach  which  retains 
off-diagonal  terms  in  the  performance  index  matrix  is  feasible.  Actual 
solution  via  this  technique  appears  impractical  except  when  numerical 
evaluations  of  performance  index  coefficients  are  desired.  Algebraic 
expressions  for  performance  index  coefficients  are  much  preferred  because 
of  the  additional  insights  which  can  be  gleaned.  Thus,  the  time  domain  is 
ultimately  abandoned  for  the  frequency  domain. 

1 .  Development 

The  time  domain  approach  to  the  inverse  optimal  problem  is  developed 
by  Kalman  in  Ref.  129.  The  essential  relationships  are  summarized  below 
for  the  general  problem. 

Plant  (nth  order) :  x  =  Ax  +  £u 

Perf orman.  ?  index:  2J  =  /“fe'Qx  +  2r'xu  +  u2)  dt 

o 

Optimal  control  law:  Uq  = 

u  =  the  scalar  control  variable 
x  =  the  state  vector  of  plant  (n  x l ) 
r  =  a  vector  of  performance  index  coefficients  (n  x  1 ) 
k  =  the  optimal  vector  of  feedback  gains  (n  x  i ) 

£  =  an  n  x 1  vector 

A  =  an  n  x  n  matrix 

Q  =  an  n  x  n  symmetric  matrix  of  performance  index  coefficients 
(  ) '  =  transpose  of  matrix 

The  inverse  optimal  control  problem  is: 

Given  Eqs.  50  and  52,  find  Q  and  r  for  which  J  is  minimum 

Solution:  Q  and  r  satisfy  the  equations 

r  +  Pb  =  k  (53) 

Q  +  PA  +  A'P  =  kk’  (51*) 

P  -■  an  unknown  il*n  symmetric  matrix  called  the  "payoff 
matrix" 


(50) 

(51) 

(52) 


C.  1 seuqple  for  Tlrat-Or&or  Floats  (a  -  1 ) 


To  illustrate  tha  general  approach,  presume  that  we  nave  data  i’or  two 
first-order  systems,  each  of  which  is  onsldered  to  be  an  optimal  system 
derived  by  minimising  the  performance  index,  2 J.  In  this  case  we  know  the 
plants,  A]  and  Ap  (fc  may  bo  set  equal  to  unity  without  loss  of  significant 
generality) ,  und  the  controller  gaine,  ar.i  kg.  (Because  the  systems  are 
i'irst-order .  all  quantities  are  scalars.)  The  problem  is  to  find  the  per¬ 
formance  index  coefficients  Q  and  r  for  which  the  two  systems  are  optimal. 


In  this  scalar  case  P  may  be  easily  eliminated,  from  Eqs.  53  and  6^ , 
giving 

Q  *  kf  -  2Aj  (k^  -  r)  -  k§  -  2Ag(kg- r)  (53) 


k|  -  kf  +  2(A1k1  -Agkg) 
Solving  for  r,  r  -  - S'(A7^7gl - 


( 56) 


Using  this  result  in  Eq.  55  gives 


(A^-Agkf)  +  2A1A2(k1  -  kg) 

A,  -  Ag 


(57) 


Values  for  Q  and  r  given  by  Eqe.  56  and  57  define  the  performance  index 
of  the  form  Eq.  51 ,  which  is  a  minimum  for  the  two  first-order  systems 
characterized  Ai ,ki  and  Ag,kg.  This  demonstrates  that  the  approach  works 
in  principle. 


The  characteristics  of  first-order  optimal  control  systems  which 
minimize  the  criterion  function 


2J  =  jT  (Qx^  +  £rxu  +  u2)  dt 


(58) 


are  summarized  below  and  in  Fig.  55: 

Optimal  control  law: 

Uq  -  -kx  where  k  =  A  -  ^(A-r)^+  (Q  -r2) 
Equivalent  open-loop  transfer  function: 

0(s)  =  k/(s-A) 


Closed-loop  inverse  time  constant: 

a  =  |/(A  -  r)^  +  (Q-  r2)  =  A- k 


(5  9) 

(6o^ 

(61) 


1  h'j 


Figure  55.  0-  and  joo-Bode  Diagram  for  First-Order  Optimal  Control  System 

Let  us  now  apply  thes '  results  to  idealizations  of  the  elementary 
manual  control  systems,  Yc  =  Kc/s  and  Yc  =  Kc  •  The  approximate  human 
operator  describing  function  forms  appropriate  to  these  controlled  elements 
are  Yp  =  Kpe  TeS  and  Kpe  TeS/(TjS  +  l),  respectively.  If,  now,  the  pure 
time  delay  terms  are  neglected,  and  the  low  frequency  first-order  lag  for 
the  Yc  =  Kc  case  is  presumed  to  be  fixed  and  is  transferred  to  the  con¬ 
trolled  element,  then  the  systems  so  idealized  fit  our  first-order  optimal 
control  format. 

Consider  first  Yc  =  Kc/s,  which  corresponds  to  A  =  0.  The  optimal 
controller  gain,  k,  which  includes  the  controlled  element  gain,  Kc,  is 

k  =  KpKc  =  -\Tq  =  -a  (62) 

The  basic  experimental  data  from  which  Q  is  to  be  derived  will  be 
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values  k-j  and  k2  taken  from  experiments  with  two  different  values  of  Kc  • 
By  virtue  of  the  <nc  invariance  property  of  cdc-Kc  independence  (see  p.  11), 
k,  =  k2  =  cnc.  Consequently  Q,  =  cuf,  r  =  0,  and  the  performance  measure 
underlying  systems  of  this  type  is 

2J  =  JT“  (oi§x2  +  u2)dt  (65) 


For  the  second  example,  A-|  =  (— l/Tj)i  and  A2  =  (— 1/Tj)2*  The  experi¬ 
mental  data  for  the  u^-Kq  independence  property  still  apply,  so  the 
crossover  frequency  is  invariant  with  Kc  changes .  As  a  second  category 
of  experimental  data,  we  appeal  to  those  data  from  which  the  equalization 
selection  and  adjustment  property,  (c),  on  p.  8  is  derived,  i.e., 

"jYpYc|  »  1  at  low  frequencies  to  provide  good  low  frequency  closed- 
loop  response  to  system  forcing  functions."  On  this  basis  the  low 
frequency  breakpoints,  l/Ti1  and  1/Tj2,  are  much  less  than  the  crossover 
frequency,  so  that 


and 


KPlKd 

0/tit) 


(6*0 


*2  ~ 


kP2k°2 

0/Tl,) 


=  Cly. 


(65) 


Using  these  relationships  in 
seen  to  be 

Q  : 


Eqs . 


OK 


56  and  57 >  the  pei’formance  indices  are 


(66) 


and  the  performance  measure  is 


2J 


X00 

(<X 


2  2 
|qX 


2o)cxu 


u2)dt 


(67) 


Although  these  examples  are  trivially  simple,  they  illustrate  the  use 
of  inverse  optimal  control  theory  for  the  evolution  of  performance  indices 
which  can  then  be  used  to  establish  estimates  for  other  systems  without 
recourse  to  the  adjustment  rules.  The  two  examples  also  make  clear  that 
the  performance  criterion  to  yield  an  optimal  controller  which  matches 
human  operator  data  is  different  for  each  type  of  plant .  For  practical 
purposes  this  may  not  be  too  awkward,  as  it  seems  likely  that  performance 
C1 iteria  can  be  developed  for  classes  of  plants  which  lead  to  reasonably 


good,  albeit  approximate,  estimates  for  the  human  controller.  For  example 
one  criterion  function  could  be  used  for  those  plants  which  approximate  Yc=Kc 
in  the  frequency  region  about  crossover,  another  criterion  for  plants  which 
are  nearly  Yc =  Kc/s  in  the  same  region,  etc. 

3  •  Problems  in  Application 

One  problem  in  extending  the  ideas  outlined  above  is  that  of  dealing 
with  the  large  number  of  algebraic  equations  implicit  in  Eqs .  53  and  54 • 

A  system  of  n  scalar  linear  algebraic  equations  results  for 

each  plant/controller  combination  (i.e.,  A,  b,  and  k  combination)  consid¬ 
ered.  We  seek  values  of  Q-and  r  which  will  be  invariant  for  these  differ¬ 
ent  plant/controller  combinations.  Thus,  — ^ ) .  + n  unknowns  arise  from  Q 
and  r,  and  — unknowns  arise  from  the  P  matrix  (corresponding  to  each 
plant/controller  combination).  If  m  is  the  number  of  plant/controller 
combinations  considered,  then  the  number  of  equations  and  unknowns  for  an 
nth-order  plant  are  given  in  Table  ME.  Notice  that  m’  is  an  integer  in 
the  last  column  for  odd  n.  When  n  is  odd,  m'  =m.  Because  m  must  be  an 
integer,  when  n  is  even,m  is  the  next  lowest  integer  ton'.  The  above  says 
nothing  about  the  existence  of  a  solution  of  the  equations.  For  a  solution 
to  exist,  the  determinant  of  the  coe'fficients  of  Eqs.  53  and  54  considered 
together  must  be  nonzero.  This  condition  has  been  met  for  the  very  limited 
number  of  cases  considered  so  far  in  the  literature. 


TABLE  XVIII 

REQUIRED  EQUATIONS  AND  UNKNOWNS  FOR  nTH- ORDER  PLANT 


NUMBER  OF  UNKNOWN 

m»  FOR  NUMBER  OF  EQ. 
TO  EQUAL 

NUMBER  OF  UNKNOWNS 

General  case  of  Eq.  56 

+mHiH+U 
2  m  2 

n  +  3 

2 

With  r^O 

1 )  ,  mn(a  +  D 

n+  1 

2 

With  qj^j  &0,  i  ■£  j 

2n-+  mSfS^U 

2  ■ 

With  r^O  and  q^j  ^0,  i^J 
(Case  treated  in  Ref.  134) 

1 

Number  of  equations  (all 
cases) 

m 

Clearly,  a  large  number  >f  equations  can  be  involved  even  for  moderately 
small  values  of  n.  For  n’  '!  then  m  =  2,  and  there  are  four  equations,  for 
n=  2  then  m*  =  2.5  and  m=  2,  so  there  are  ten  equations.  If  we  take  n  =  3 
(which  provides  a  minimal  representation  of  the  human  pilot  situation), 
m=  3  for  the  general  case  (the  only  one  applicable  for  our  purpose)  and 
tha  number  of  equations  (and  unknowns)  is  27.  The  matter  has  progressed 
beyond  the  realm  of  practical  analytical  solution,  although  numerical 
solution  remains  a  distinct  and  practical  possibility. 

Another  difficulty  in  the  application  of  straightforward  and  conven¬ 
tional  optimal  control  theory  to  the  generation  of  estimates  for  pilot 
control  behavior  is  the  occasional  presence  of  lags  in  the  pilot  model. 

Thus,  for  a  fairly  general  controlled  element  transfer  function, 


m_ 

c 


Kc 

d2s2  +  di  s  +  dQ 


(68) 


the  pilot  describing  function  may  have  the  approximate  form 

c  -Kp(-ts+1)(Tls  +1) 

~  =  (ii)Ss  +  ,) -  (69) 

where  we  have  approximated  pilot  time  delay  by  a  lead  term  (— rs+  l)  instead 
of  a  Pade.  Here  c  is  the  actual  output  of  the  human  operator  presuming  his 
remnant  is  zero.  Because  the  optimal  regulator  problem  results  in  a  control 
law  consisting  of  linear  feedbacks  of  the  plant  output  variable  and  its 
first  (n— l)  time  derivatives,  it  is  more  appropriate  for  the  application 
of  conventional  optimal  control  theory  to  redefine  the  plant  and  controller 
as 


m 

Kc 

(70) 

uo 

(Ti;Ns+1)(d2s2+d1s  +d0) 

Uq 

e 

=  -Kp(-rs  +  1  )(Tls  +  1 )  ;  e  =  — m 

O’1 ) 

Kc,  d0,  d^ ,  and  d2  are  controlled  element  parameters,  while  Kp,  t,  Tl, 
and  Tj^jj  are  parameters  of  the  pilot  describing  function.  This  vas  the 
procedure  adopted  previously *  in  the  first-order  system  example  for  Yc  - 


Recently,  Rynaski  and  Whitbeck  (Ref.  131)  have  shown  that  the  inclusion 
of  cost-of-control  rates  in  the  performance  index  results  in  optimal  con¬ 
trollers  containing  lags.  Since  formulation  in  terms  of  Eqs.  70  and  71 
amounts  to  assuming  that  Tj^jj  is  known  or  can  be  found  by  other  means, 
inclusion  of  control  rates  or  their  equivalent  in  the  performance  index  and 
use  of  Eq.  68  for  definition  of  the  plant  seems  most  appropriate.  However, 
this  does  not  lead  to  a  reduction  in  the  number  of  equations  that  must  be 
solved  simultaneously,  and  the  really  fundamental  difficulty  of  dimension¬ 
ality  remains.  For  this  reason,  the  time  domain  approach  is  set  aside  in 
favor  of  frequency  domain  techniques.  The  latter  offer  some  promise  for 
reducing  the  number  of  equations  which  must  be  solved  simultaneously. 

a.  mqpsrcY  domain  techniques 

The  frequency  domain  formulation  for  the  single-input,  single-output 
controlled  element  is  the  case  of  interest  here.  The  effect  of  a  random 
input  generated  by  shaping  white  noise  with  a  first-order  lag  is  included 
for  a  small  expenditure  of  effort  by  taking  advantage  of  the  transient 
analog  concept  (see  Ref.  123).  The  development  follows  the  approach  used 
by  Rynaski  and  Whitbeck  in  Ref.  131  .  It  differs  from  that  presented  in 
Ref.  131  in  that  frequency-weighted  error  is  used  in  the  performance  index, 
and  cross-products  between  the  frequency-weighted  error  and  the  control  are 
included  in  the  performance  index  (see  Ref.  123).  The  former  refinement 
admits  lags  into  the  optimal  controller  in  much  the  same  manner  as  cost-of- 
control  rate  terms  do  in  Ref.  131  .  The  advantage  of  this  alternate  method 
is  that  existence  of  the  first  variation  of  the  performance  index  on  the 
control  is  not  crucially  dependent  on  the  choice  of  the  random  input  shaping 
filter.  The  problem  is  defined  according  to  Fig.  5^  • 


Figure  5^  •  Block  Diagram  for  Frequency  Domain  Formulation 
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where  Y_  =  the  controlled  element  transfer  function 


e 

c 

m 

F 


the  transient  analog  of  the  random  input  with  power 
spectral  density  given  by  $a(oi)=  o^/(oo?  +  cw2) 

the  displayed  error 

the  control  variable,  limb  position 

the  controlled  element  output  variable 

the  frequency  weighting  applied  to  m  and  i 


The  Laplace- transformed  equations  for  the  frequency-weighted  variable 
and  plant  are  given  by 


[Yj  = 


Yil 

0 

[i(s)/F 

.Y  ~ 

Yc/F. 

O(s)  ♦  [  o 

=  w(s)c(s)  +  b(s)  (72) 


w(  r )  = 


’  0 

Yc/F 


b(s)  = 


i(s)/F 

0 


and  m(s)  =  Ycc(s)  (73) 

Using  Parseval's  theorem,  the  performance  index,  Eq.  51,  is  converted 
to  its  frequency  domain  equivalent,  where  the  state  vector  of  interest  is 
now  [Y]  above. 

/JOO 

(YTQY  +  Y'rc  +  r’Yc  +  cc)ds  ('Jh) 


where  Y  =  Y(-s),  etc,  Q  and  r  are  weighting  coefficients  as  follows: 


*11 

2 

V 

Q  = 

*12 

^22_ 

y 

r  - 

_r2 

Substitute  from  Eq.  72  to  eliminate  Y,  getting 

I 

j(cw’  +  S)Q(wc  +  b)  +  (cw*  +  B')rc 


+  cr'  (wc.  +  b) 


ccjds 


(73) 


'51 


Now,  take  a  variation  on  c,  letting 


(76) 


c  =  Cq  +  Xc^ 

where  cq  is  the  optimal  control  and  c-|  is  any  arbitrary  variation  on 
the  control.  Then,  that  component  of  2J,  Jc  (see  for  example  Ref.  131), 
containing  the  first  variation  is 


A  1  /*+J“  c-|z(s)ds  (78) 

=  2"J  4- 


letting  Yc(s)  =  N(s)/D(s),  z(s)  becomes 


z(s)  = 


q22^N  +  r2(NDF  +  NDF)  +  DFDF 


DFDF 


q-|2N  +  r-|DF 


The  q's  and  r’s  and  the  coefficients  in  F  are  the 
(unknown)  coefficients  in  the  performance  index 


The  numerator  of  the  coefficient  of  cq  in  Eq.  79  is  the  root- squared  locus 
expression  (Ref.  1 31 ) .  Note  that  if  the  order  of  N(s)  is  the  same  or  less 
than  that  of  D(s),  Jc  will  exist  as  long  as  the  random  input  shaping  filter 
has  more  poles  than  zeros. 

Solution  for  the  optimal  control,  cq,  is  obtained  by  setting  Eq.  78  to 
zero  by  the  following  method.  Set  z(s)  equal  to 


z(s)  =  yYcq  +  Ji 


(80) 


where  the  zeros  of  Y  are  the  left  half  plane  zeros  of  the  c0  coefficient  in 
Eq.  79  and  the  poles  of  Y  are  the  factors  of  DF.  (As  pointed  out  in  Ref.  l3i, 

there  is  no  need  for  the  roots  of  DF  to  be  in  the  LH.P.)  The  optimal  control 
is  then  given  by 


where 


denotes  the  sum  of  those  terms 


in  the  partial  fraction  expan¬ 


sion  of  the  enclosed  expression  having  left  half  plane  roots.  Solution 


of  the  direct  optimal  control  problem  per  se  is  not  the  immediate  concern 
here.  However,  it  enables  a  solution  of  the  inverse  problem  to  be  obtained 
wherein  cq  and  the  parameters  of  the  open-  and  closed- loop  systems  are  known. 


The  objective  is  then  to  solve  for  q’ s  and  r’s  and  the  coefficients  in  F. 
,  rn. l  - pontroigproeedure  to1  provide  control  law. ,, 


transfer  functions  of  the  (observed)  form 


-Kp  (j*  -  +  ') 

(Is  +  ’H*!,*8  +  ’) 

This  contains  a  Pade  approximation  to  a  time  delay, 


e 


— TS 


*  1) 

(*■  +  1) 


(82) 


(83) 


a  lead  time  constant,  Tl,  and  a  lag  compensation  or  neuromuscular  system 
time  constant,  Tj^N-  All  these  are  needed  for  a  reasonably  general  opti¬ 
mal  controller  which  is  to  approximate  the  pilot  describing  function,  Yp. 
Thus,  the  optimal  controller  must  contain  a  maximum  of  two  lags.  This 
requirement  in  turn  requires  that  the  frequency  weighting,  F,  be  of  the 
form 

F  =  f2s2  +  f  1  s  +  f  0  (8^ ) 


This  forces  the  root-squared  locus  expression  to  have  two  poles  in  addi¬ 
tion  to  those  from  the  controlled  element. 


Consider  the  case  for  Yc  =Kc/s.  Then  the  simplifying  assumption  that 
Ti  N  =  tN  =  tL  is  valid;  and  for  a  compensatory  tracking  loop,  we  desire  a 
cq  of  the  form 

-CJdxi(0)KpS  (s  — j-) 


c0  = 


s^  +  ( T  KpKcjs  + 


s  +  CD. 


i) 


(85) 


Because  of  the  above  assumption,  f2  in  2q.  8k  can  be  zero  since  only  a 


single  lag  is  needed  in  the  optimal  controller.  Furthermore,  one  of  the 
q's,  r’s,  orf's  may  be  arbitrarily  set  equal  to  unity  without  loss  of 
generality.  We  shall  set  f-j  =1  and  choose  f0=2/x  so  that  the  frequency 
weighting  will  be  part  of  the  system  open-loop  transfer  function. 

Enough  relations  are  now  available  to  solve  for  the  unknown  coeffi¬ 
cients  of  the  performance  index.  The  closed-loop  roots  of  the  system 
multiplied  by  their  right  half  plane  images  must  equal  the  f normalized) 
root-squared  locus  expression,  i.e.: 


CL  Characteristic 


■Soot  Square  Locus 


^  +  (2Kcr2  -  f|)s2  +  q^  (86) 


The  left  side  of  Eq.  86  comes  from  the  denominator  of  Eq.  05,  our  postulated 
cq,  while  the  right  side  comes  from  the  numerator  of  the  Cq  coefficient  in 
Eq.  79,  the  theoretical  cq,  with  F  =  f i  s  +  f o  =  s  +  Fq*  Matching  coefficients 
of  like  powers  of  s,  and  using  fQ  =  2/t  as  noted  above 

r2  *  ^(KpKc  --f)  (87) 


q22 


(88) 


Now  Eq.  8l,  which  states  tne  optimal  control  law,  must  be  satisfied.  From 
Eqs.  79  and  60, 


Y 


(89) 


Jl 


(90) 


Substituting  Eqs.  85,  89,  and  90  into  Eq.  8l 
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Cq  = 


-<DiXi(0)KpS  |s  -  -f-j 
(s  +  «Oi)[s2  +  -  KpKcjs  + 


-s  j 

Ui) 

1  t/ 

GDjX^O)^  | 

qi2K=) 

1 

Mt- 

\  2KpKc 

-  KpKcjs  +  —ip 

s2  ”  (~  -  KpKcJ  s  + 

(s+1 

l  T 

-)(s  +  ^i) 

(9i ) 

Again  matching  coefficients  of  like  powers  of  s ,  two  algebraic 
equations  linear  in  r-|  and  q-|2  are  obtained.  Solving  for  r-j  and  q-^j 


where 


r1  =  ^(KpKoS(“i)  -  t) 


(92) 


(93) 

(9^) 


q1 1  is  not  involved  in  any  of  the  above  equations ,  and  in  fact  q-j  -j  may  be 
any  arbitrary  quantity.  That  this  is  true  can  be  demonstrated  by  solving 
the  direct  optimal  control  problem  as  a  check  with  the  performance  index 
coefficients  given  by  Eqs.  87,  88,  92,  93,  and  94  with  q-j  -|  arbitrary. 

At  this  point  we  have  obtained  a  formal  solution  to  the  problem  we 
set  out  to  solve.  (The  solution  is  given  by  Eqs.  87,  88,  92,  93,  and  94.) 
It  remains  for  us  to  assess  suitability  of  this  answer.  In  short,  the 
results  are  not  very  gratifying.  This  is  so  because  the  performance  index 
is  not  a  function  of  the  difference  (y^  — y),  but  is  a  function  of  and  y 
separately.  Inasmuch  as  only  the  displayed  error  (i-m)  and  the  pilot's 
output,  c,  are  explicitly  known  to  the  pilot,  we  would  expect  that  any 
reasonable  performance  index  would  involve  quantities  linearly  related  to 


these  explicitly  known  quantities ,  in  particular  (yj.-y).  However,  it 
does  not. 

We  might  place  an  additional  restriction  upon  the  performance  index 
so  that  it  is  a  function  of  (yi~y).  The  necessary  restriction  is  that 

2  1  (9?) 

However,  Eq.  9U  shows  that  Eq.  95  holds  only  when 

oij_  =  0  (96) 

KpKc  =  +  2ai±  =  aic  (97) 

The  condition  of  Eq.  96  is  acceptable,  but  only  applicable  when  there 
is  no  input.  It  is  conceivably  suitable  as  an  approximation  for  very 
low  input  bandwidths.  The  condition  of  Eq.  97  is  unacceptable  because 

0  <  03c  <  2/t  (98) 


must  be  satisfied  for  the  closed-loop  system  to  be  stable. 
For  the  o3j_  =  0  condition  the  performance  indices  are 


Experimental  data  for  Yc  =  Kc/s  systems  can  now  be  inserted  in  Eq.  99- 
Again  using  the  cuc,  Kq  independence  data,  and  the  approximation  KpKc  1  coc, 


( 100) 


Data  (u\-.,  t,  Ko)  from  only  one  system  are  needed  to  establish  these  indices, 
after  which  the  performance  criterion  function  can  be  used  to  obtain  at 
least  approximate  results  for  plants  which  approximate  Yc  =  K/s  in  the 
region  of  crossover. 
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The  complications  in  even  this  simple  exercise  of  the  inverse  optimal 
control  approach  are  sufficient  to  indicate  that  more  complex  systems 
will  require  an  almost  exclusively  numerical  treatment. 
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SECTION  X 


OBTAINING  SOMAN  PILOT  DESCRIBING  FUNCTIONS 
PROM  CROSSOVER  MODELS  AND  OPTIMAL  CONTROL  THEORY 

The  purpose  of  this  section  is  to  set  forth  a  method  for  adapting  the 
describing  function  portion  of  the  quasi-linear  human  pilot  model  to  a 
given  controlled  element.  This  is  the  same  goal  sought  using  the  inverse 
optimal  approach.  Here,  however,  emphasis  is  placed  more  upon  achieving 
a  serviceable  method  than  upon  the  niceties  of  its  construction.  Within 
this  context  we  are,  at  last,  more  than  modestly  successful  in  demonstrating 
that  optimal  control  theory  can  indeed  be  used  effectively  to  develop  a 
pilot  describing  function  appropriate  to  a  given  controlled  element. 

This  method  assumes  that  all  pilot/controlled-element  combinations  in 
compensatory  tracking  are  well  approximated  in  the  crossover  region  by  the 
so-called  crossover  model  presented  in  detail  in  Ref.  12.  This  crossover 
model  has  a  frequency  response  function: 


G(jffi) 


<nce 


Jayre 


(101) 


We-  shall  represent  the  effective  reaction  time  delay  factor,  e  ^mT|S,  by 
a  Pade  approximation  to  avoid  the  mathematical  difficulty  of  dealing  with 
this  factor  in  closed-loop  analyses. 


e-^e 


Te/2  -  Jo? 
xe/2  +  jo 


(102) 


Because  the  above  model  has  been  found  to  prevail  over  a  spectrum  of 
controlled  elements  including  the  pure  gain,  single  integration,  and  double 
integration  or  pure  inertia,  it  seems  reasonable  to  generalize  and  assume 
that  the  human  pilot  adapts  in  such  a  way  as  to  cause  the  frequency  response 
of  the  combination  of  his  describing  function  and  a  given  controlled  element 
to  "closely  approximate"  thtt  of  G(jco)  over  the  frequency  range  near  pilot/ 
vehicle  system  crossover.  This  is,  in  fact,  a  basis  for  the  first  adjustment 
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rule  on  "Equalization  Selection  and  Adjustment"  (p.  8).  Our  use  of 
optimal  control  theory  in  this  section  will  be  to  effect  this  "close 
approximation, "  that  is,  to  aiapt  the  human  pilot  describing  function 
for  control  of  the  given  controlled  element. 

In  the  following  subsections  we  show  that  this  approach  is  feasible 
and  consistent  with  what  is.  known  to  be  good  servo  synthesis  technique. 
Then  we  apply  the  method  to  a  practical  problem  which  can  be  checked 
against  existing  data. 

A.  TUBTZILm  OF  APPROACH 

The  approach  is  most  easily  explained  in  terms  of  the  block  diagram 
in  Fig.  55-  The  model  in  Fig.  55a  depicts  the  situation  of  the  crossover 
model  in  a  compensatory  tracking  loop  structure.  This  loop  structure  is 
often  called  "the  unity  gain  feedback  configuration"  and  the  crossover 
model  "the  open-loop  transfer  function."  For  the  feasibility  assessment 


(a)  Model 


N/A 


( b )  System 


Figure  55*  Block  Diagram  for  Model  and  System 
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let  us  temporarily  use  these  more  general  terms  while  dealing  with  more 
general  matters.  The  model  is  forced  by  the  transient  analog  of  R-C 
filtered  white  noise,  i.  (See  Ref.  123  for  development  of  the  transient 
analog  concept.)  The  output  and  error  in  the  model  are  denoted  by  m* 
and  e*,  respectively. 

The  system  in  Fig.  55b  has  the  same  input  and  loop  structure  as  the 
model.  However,  the  open-loop  transfer  function,  N/A,  is  separated  into 
two  elements.  One  is  the  specific  controlled  element,  Yc>  to  be  controlled 
and  the  other  is  the  pilot,  or,  in  more  general  terms,  the  controller.  The 
control  variable  is  c.  The  output  and  error  of  the  system  are,  respectively, 
m  and  e.  At  this  point,  the  system  controller  is  unspecified.  The  object 
is  to  calculate  the  controller  transfer  function  that  will  minimize  the 
weighted  sum  of  the  mean-squared  difference  between  model  and  system  out¬ 
puts,  plus  the  mean-squared  control  variable.  Put  qualitatively,  we  are 
goii  g  to  trade  increased  response  error  in  an  optimal  way  for  a  reduction 
in  required  control  activity  through  selection  of  the  controller.  This 
objective  can  be  stated  mathematically  as 

Minimize  the  performance  index,  J, 
with  respect  to  c,  where 

J  *  jq(m-m*)2  +  c^j  dt  (103) 

The  constant,  q,  is  the  weight  in  the  sum  of  performance  index  terms 
known  as  the  ratio  of  the  cost  of  error  to  the  cost  of  control.  We  can 
define  the  response  error  as 

e  6  m  -  m*  =  e*  -  e  (104) 

for  brevity  and  rewrite  Eq.  103  in  the  frequency  domain  using  Parseval's 
theorem,* 

J  =  2n‘ |  JJa°  (q?e  +  5c)  dt>  (105) 

J00 

where  now  c  =  c(s),  e  =  e(s),  and  c  -  e(-s),  etc.  Response  error  can  be 

*We  tacitly  assume  here  that  c  and  c  are  ouch  that  the  conditions  on 
Parseval's  theorem  for  equivalence  of  Eqs.  105  and  105  are  satisfied. 
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expressed  as  a  function  of  the  control,  c. 


-  Y=<8>c<s>  -  rTG&y(irk) 


=  w(s)c(s)  f  b(s) 


Oo6a) 

(106b) 


At  this  point  ve  have  expressed  the  key  elements  needed  as  inputs  for  the 
optimal  control  procedure.  The  details  of  the  derivation,  which  follows  Ref. 
131  in  most  respects,  are  sketched  below,  and  can  be  bypassed  if  desired. 

Necessary  and  sufficient  conditions  for  the  control  to  be  optimal 
in  the  sense  that  J  is  minimized  are : 

The  first  variation  of  J  on  c  must  vanish  for  c  =  co+  Xc-|  , 
where  cq  is  the  optimal  control  and  c-|  is  any  arbitrary 
stable  control  variation. 

The  second  variation  of  J  on  c  must  be  greater  than  zero. 

By  substituting  Eq.  106b  and  c  =  co  +  Xc^  into  Eq.  i  05  >  we  can 
obtain  an  expression  for  Jc,  which  is  that  component  of  J  con¬ 
taining  the  first  variation  with  respect  to  . 


Jc  =  2^3  /_ j!  C1  l^1  +^)c0  +  qffbjds 

A  _JL  f  +Jo°-  ,  \  A 
=  §7T  J_1oo  clZ(s)ds 


(107) 


(108) 


Since  ,JC  must  vanish  and  corresponds  to  a  stable  function  of 
time  for  t<0  and  to  zero  for  t^O  (ci  is  analytic  in  the  left 
half  plane),  z(s)  must  correspond  to  a  function  of  time  which 
is  zero  for  t2:0.  That  is,  z(s)  must  be  analytic  in  the  left 
half  plane. 

An  expression  for  J4,  that  component  cf  J  containing  the  second 
variation  with  C] ,  can  be  similarly  obtained. 


1  J06 

J<i  =  277  ^  Ci  (1  +  q«w)c!  ds 

*■"  J 00 


(ion) 


For  J(j>0,  (l  +Qww)s=jaj  >  0  for  all  o>.  The  quantity  (l  +  qww)  is 
that  involved  in  the  so-called  root-squared  locus  expression: 


1  +  qww  =  0 


(MO) 


Therefore  the  condition  > 0  is  equivalent  to  the  condition 
that  no  zeros  of  Fq.  HO  lie  on  the  imaginary  axis  of  the 
complex  plane. 

Now,  if  we  set  1  +  qww  =  YY  (ill) 


where  Y  is  analytic  in  the  right  half  plane  and  has  as  its 
poles  the  poles  of  w  and  let 


J-]  =  qwb 


(112) 


in  Eq.  107,  then  for  the  optimal  control,  Y?cq  +  Ji  =  z  =  0, 
and 


1 

c0  -  y 


4Ji 

Y 


(113) 


[  ]+  denotes  the  sums  of  the  terns  in  the  partial  fraction 
expansion  of  [  ]  having  left  half  plane  poles.  The  poles  of 
[  ]  are  associated  with  functions  of  time  which  are  zero  for 
t<5  and  are  stable  for  t>0.  Hence  we  see  that  co(t)  is  a 
stable  function  of  time  for  t  >0  and  zero  for  t<0  by  defini¬ 
tion  of  the  symbols  in  Eq.  113- 


As  stated  previously,  z(s)  must  correspond  to  a  function  of  time 
which  is  zero  for  t  >  0  to  satisfy  the  conditions  for  Cq  to  be 
optimal.  From  Eqs .  107,  108,  and  112,  we  can  check  to  determine 
whether  Eq.  1 1 3  is  consistent  with  that  requirement. 


z(s)  =  Y7c0  + 


(iiM 


Substituting  for  cq  using  Eq.  113  and  noting  that 


gives 


z(s) 


-Ji 


(H5) 


(1 16) 


Hence  z(t)  is  zero  for  t>0  by  the  definitions  of  symbols 
given  above  and  the  fact  that  the  poles  of  w  are  the  poles 
of  Y  and  these  correspond  to  time  functions  which  are  zero 
for  t>0. 
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The  optimal  control  for  the  specific  problem  at  hand  is  obtained  by 
substituting  for  Y  and  J-]  in  Eq.  113- 


c0  =  - 


1  -qo)iYeG/[(s  coj)(  1  +  G)j 

(1  +  qYcYc)  +  ( 1  +  qYcYc)_ 


M  17) 


where  (  )  =  (  )+(  )  and  the  poles  and  zeros  of  (  )+  are  in  the  left 
half  plane . 

Let  us  now  proceed  to  determine  the  forms  for  the  optimal  controllers 
for  Yc=Kc,  Kc/s,  and  Kc/s^  when  the  crossover  model  is  G(s)  -o^/s. 

1 .  Pure  (kin  Controlled  Eleaent :  Yc  =  Kq 

For  Yc = Kc  the  Laplace  transform  of  the  optimal  control  is 


qK§  ojc/Kc  a>i 


qK§  U)C/KC 


c  + - - - Xi 

( 1  +  qK§ )  (s+<%)  ( s  +  )  ( 1  +  qK§ )  ( s  +  a>c ) 


(l  IP) 


From  Fig.  55b , 


~(S)YC(S) 


N 

A+N 


('  0 


and  the  controllei  transfer  function  is 


Yp(s)  =  ^-|(s) 


c0,  \ 

r~  (5) 


1  -  ^(s)Yjs) 


Substituting, 


YnCs) 


<lKc 

^  1  +  ql<f 


(  20) 


(  2.) 


1  +  qjd 


Several  features  of  this  optimal  controller  transfer  function  for  Y Kc 
should  Le  noted  here: 


e  If  the  controller  characteristics  are  to  be  independent 
of  the  controlled  element,  gain,  the  product  qK'c  should 
be  an  invariant  parameter. 


•  For  qK£  >  1  the  compensation  in  the  controller  is  a  low 
frequency  lag,  i.e.,  with  breakpoint  less  than  cjc^. 

•  As  YpYc that  is,  Yp (ol^/K^/s  (pure 

integration  behavior). 

•  The  controller  is  independent  of  the  input  bandwidth, 

2.  Single - Integrator  Controlled  X lament:  yq  =  Kq/b 

For  Yc  =  Kc/s  the  optimal  control  will  be 


c0 


s 

+  V^c)( 

“d  +  V 

31 )h 

\s  + 

f  qjc^  +  at  +  cojl 

1 

|s  + 

)(s  + 1 

/5i) 

xi 

0  22) 


Substituting  into  Eq.  120  yields  a  controller  for  Yc  =  K^/s  of  the  form 


s  (s 

I  1 

+  V&i  + 

*  1 

(“t  +  Vqi^)(a>L  + 

+  “fc) 

1 

(123) 


where  |s  +  o>|j|s  +  o^j  =  (s  +  o^s  +  f/qjcf) 


(124) 


The  root  locus  of  (cq/x^)Yc  below  indicates  the  relative  values  of  cu i 
and  u£  for  "small"  values  of  and  "large"  values  of  V5kI- 


It  can  be  shown  that  as  coi-^O  or  as 


o>^  -**0;  and  as 


02  — 


+  4 
V^cf 
+  -^-_ 


It  can  also  be  shown  chat  the  roots  are  contained  in  the  left  half  plane 
for  all  o)^  when  YqK§  >  0. 

The  pertinent  features  of  this  optimal  controller  transfer  function 
for  Yc  --  Kc/s  are: 

•  If  the  controller  characteristics  are  to  be  independent  of 
the  controlled  element  gain,  the  product  m  should  be  an 
invariant  parameter. 

•  For  VqiS  >  coc  the  compensation  in  the  controller  includes 
a  differentiation,  very  low  frequency  lag,  high  frequency 
lag,  and  high  frequency  lead. 

•  As  VqK§  YpYc  -'►a>c/s  .  That  is,  Yp-^-o^/Kc  (pure  gain 

behavior) . 

5-  Double -Integrator  Controlled  Element:  Yc  *  Xc/e2 

The  optimal  control  for  Yc  =  Kc/s2  is 


where 


and 


(125) 
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Substituting  into  Eq..  120  yields  a  controller  for  Yc  =  Kc/s2  of  the  form 


where 


^  2 /  a0\ 

_  jgaiS  (st?r) 

P  (s  +  oj])|s  +  co^s  +  a 

(s  +  o>,)(s  +ccg)js  +CD3)  =  (s +0^)(s2  +  Vqi^  s +y5^) 

-  0VM  (s  +  5") 


(126) 


(12?) 
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It  can  also  be  shown  that  o>]  kO  for  all  coj_  when  jqKj  >  0. 

The  pertinent  features  of  this  optimal  controller  transfer  function  for 
Yc  =  Kc/s2  are: 
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•  If  the  controller  characteristics  are  to  be  independent  of 

the  controlled  element  gain,  should  be  an  invariant 

parameter. 

•  For  coc,  the  compensation  in  the  controller 

includes  a  double  differentiation,  very  low  frequency  lag, 
high  frequency  lead,  and  high  frequency  lag. 

•  As  V5i.— »>  YpYc-*-a^/s.  That  is,  YP-*-sa>c/Kc  (pure  rate 
behavior) . 

4.  General  Features  of  These  Optimal  Controllers 


There  are  several  features  to  be  appreciated  in  connection  with  the 
entire  above  group  of  controller/controlled-element  pairs: 


To  obtain  "good"  high  frequency  controller  cutoff  charac¬ 
teristics  in  the  case  of  Yc  =  Kc/s^,  and  qualitatively 
comparable  "good"  low  frequency  characteristics  in  the 
controller  for  Yc  =  Kc,  we  see  that 


8(n)l 

should  be  "large"  and  approximately  constant  for  all 
systems,  n  is  the  number  of  controlled  element  poles 
less  the  number  of  zeros,  and 


6(n) 


1  ,  n  =  0 
0  ,  n  /  0 


As  we  may  correctly  interpret  the  results  as 

pertaining  to  systems  having  an  optimal  step  response. 
Since  many  specifications  in  conventional  control  tech¬ 
nology  concern  step  response  characteristics,  these 
optimal  controller/controlled-element  pairs  are  summa¬ 
rized  in  Table  XIX. 


Clearly,  the  above  controller/controlled-element  pairs  satisfy  the 
primary  rule  of  thumb  of  frequency  response  synthesis:  "Find  or  create 
a  fair  stretch  of  —20  db/decade  slope  for  the  amplitude  ratio  of  the 
open-loop  frequency  response  function,  and  then  make  it  the  crossover 
region  by  putting  the  0  db  line  through  it."  That  is,  make  |YpYc(jco)] 
approximate  |K/ja)|  in  the  frequency  region  about  |YpYc|  =  1  •  This  crude 
prescription  for  acceptable  stability  and  response  is  generally  adequate 
for  minimum  phase  systems.  It  can  be  extended  directly  to  nonminimum 
phase  systems  by  adding  a  prescription  for  a  positive  phase  margin. 
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TABLE  XIX 

OPTIMAL  CONTROLLER  AND  CONTROLLED  ELEMENT  PAIRS  FOR  STEP  INPUT 


CONTROLLED 

ELEMENT , 

Yc 


CONTROLLER,  Y-n 

(«L  =  0) 


cue  qK 


Kc  1  + 


1  +  qK§ 


i§rr^:  [s  +  **) 


1  +  iJ  ^  +  a§ 


*“1 


What  is  more,  certain  "practical"  characteristics  are  displayed  by 
these  controllers  outside  of  the  crossover  frequency  region.  In  the  case 
of  Yc  -  Kq,  the  controller  compensation  takes  the  form  of  a  pseudo¬ 
integration  or  lov  frequency  lag.  For  Yc  =  Kc/s2,  the  differentiation 
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needed,  in  the  controller  for  the  crossover  frequency  region  is  cut  off  at 
high  frequencies  by  lag.  Each  of  these  characteristics  in  the  respective 
optimal  controllers  is  a  most  elementary  yet  crucial  consideration  in 
design  practice  for  the  physical  realization  of  actual  controllers.  Hence 
we  may  regard  this  particular  formulation  of  the  optimal  control  problem 
as  a  step  forward  in  relating  conventional  control  technology  and  optimal 
control  theory. 

At  this  point  we  can  claim  feasible  by  for  the  approach  outlined  in 
the  introductory  remarks  of  this  section  merely  by  noting  that  the  con¬ 
trollers  we  have  been  discussing  can  be  made  fairly  reasonable  facsimiles 
to  the  human  pilot  describing  function  in  spite  of  the  oversimplified 
crossover  model  used. 

The  remaining  task  before  us  is  proper  selection  of  the  parameters  of 
the  crossover  model,  G(jo>) .  Fortunately  an  extensive  distillation  of  a 
large  collection  of  human  pilot  describing  function  data  (Ref.  12, 
pp.  1^5- 164,  173—176,  179—182)  can  supply  these  parameter  values.  This 
material  also  enables  us  to  include  the  effects  of  variations  observed  in 
human  pilot  crossover  data  of  Te  and  o>c  with  cs*  and  possibly  controlled 
element  type  in  the  human  pilot  describing  function  calculation. 

In  the  next  subsection  we  will  use  this  method  to  compute  the  human 
pilot  describing  function  appropriate  to  a  novel  controlled  element  and 
compare  the  results  with  actual  measurements. 


B.  COMPUTING  A  HUMAN  PILOT  DESCRIBING  FUNCTION 


We  have  chosen  the  following  example  to  illustrate  the  method:  Given 
the  controlled  element, 


Kr 


s(s-  1  .0) 


(126) 


in  a  compensatory  control  system  forced  by  R-C  filtered  white  noise  with 
bandwidth 

u>l  =  1  .5  rad/sec  (129) 

find  an  appropriate  human  pilot  describing  function,  Yp. 
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The  first  step  is  to  select  an  appropriate  crossover  model  from  Ref.  12. 
Since  the  controlled  element  is  somewhat  like  Kc/s2  in  the  probable  cross¬ 
over  region,  we  can  use  those  crossover  model  parameters  here.  Assuming 
equivalence  of  the  input  bandwidth  parameters,  o>j_,  the  crossover  model 
(Table  XU,  Ref.  12)  is 


G(ja>) 


J<0  JOi 


(150) 


Converting  to  the  s-domain  and  using  the  Pade  approximation: 

-  r3fei)2)  03D 

The  next  matter  is  to  select  a  value  for  (qK§)1//,1+.  Recalling  that 
this  parameter  determines  the  high  frequency  cutoff  for  the  system,  and 
that  such  an  effect  could  be  attributed  to  the  high  frequency  neuromuscular 
system  dynamics  (see  pp.  164-171  of  Ref.  12),  a  reasonable  number  would 
seem  to  be  yqK2  =  10.0 rad/sec.  Actually,  we  shall  consider  a  range  of 
values  for  this  parameter  to  see  Just  how  good  this  guess  is; 


qK2  =  102,  10',  104,  105,  106,  »  radVsec4 


Solving  for  the  optimal  control  (given  by  Eq.  117)  enables  us  to  solve 
for  the  optimal  controller  transfer  function,  or,  as  we  shall  call  it  in 
proper  context  here,  the  "appropriate"  pilot  describing  function  Yp  for 
Yc  =  Kc/s(s  — 1.0).  The  parameters  for  this  describing  function  for  the 
several  values  of  qK§  listed  above  are  given  in  Table  XX.  The  form  of  Yp 
is 


[s2  +  25JJONS  + 


or 


— Kps(s  -  1 .0) (s  +  zi ) (s  +  z2) 

(s  +  Pt )(s  +  p2)  [s2  +  2£Di£S  +  o|] 


(152) 


Notice  in  the  last  column  of  Table  XX  that  as  the  cost  of  error  relative 
to  control  approaches  infinity,  YpYc  approaches  the  crossover  model  G(s)  , 
as  indeed  it  should. 
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TABLE  XX 


PARAMETERS  OF  Yp 


10* 

4 

10 

105 

106 

^  00 

KpKc 

-4.69 

-2.35 

16.19 

52.8 

117-0 

3.25  (00) 

21 

-9.53 

-6.24 

-5.52 

-3.2 

z2 

11.37 

16.47 

26.33 

00 

0.5^7 

0.796 

% 

5.59 

14.79 

Pi 

0.390 

-0.149 

-0.133 

-0.045 

-0.028 

0 

P2 

2.95 

3-73 

4.38 

4.89 

5-13 

5.2 

0.363 

0.510 

0.564 

O.616 

0.654 

V272 

<«D 

4.39 

6.27 

10.52 

18.10 

31  -75 

00 

Equation  1 32  shows  that  the  computed  pilot  describing  function  contains 
a  zero  which  cancels  the  unstable  pole  of  Yc.  (Cancellation  of  the  Yc 
poles  will  always  occur  in  the  optimal  solution  when  only  one  loop  can  be 
closed  by  the  pilot.)  Usually  this  is  not  a  physically  acceptable  situa¬ 
tion  since  the  cancellation  cannot  be  exact  in  practice.  However,  in  the 
case  of  the  pilot  describing  function,  we  are  really  concerned  with  obtain¬ 
ing  a  mathematical  representation  of  the  pilot.  From  this  point  of  view, 
the  situation  is  acceptable. 
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The  open- loop  frequency  response  function,  YpIc,  is  shown  plotted 
in  Fig.  5 6  for  qK§  equal  to  104  and  in  Fig.  57  for  other  values.  The 
results  in  Fig.  56  seem  to  best  fit  the  measured  YpYc  where  the  pilot 
was  controlling  Yc  =  Kc/sC s- 1 .0) .  That  this  is  so  lends  support  to  our 
assumption  that  the  high  frequency  neuromuscular  dynamics  may  be  identi¬ 
fied  with  the  cutoff  characteristics  of  the  optimal  control  formulation. 

Notice  that  the  calculated  frequency  response  departs  from  the  cross¬ 
over  model  frequency  response  in  the  direction  of  the  YpYc  frequency 
response  measurements.  Also,  the  calculated  frequency  response  best  fits 
the  data  in  the  frequency  region  near  crossover. 

The  fact  that  the  calculated  frequency  response  does  not  fit  the  YpYc 
measurements  very  well  at  high  and  low  frequencies  is  not  a  cause  for 
faulting  the  method.  The  discrepancy  at  high  frequency  stems  from  the 
use  of  a  simple  low  order  Pade  approximation  to  the  effective  reaction 
time  delay  term  in  the  crossover  model.  At  low  frequencies  the  devia¬ 
tions  in  both  phase  angle  and  amplitude  ratio  from  the  measured  quanti¬ 
ties  are  probably  due,  at  least  in  part,  to  the  absence  of  a  lew  frequency 
neuromuscular  phase  lag  representation  in  the  crossover  model.  Inclusion 
of  this  effect  is  possible  by  using  the  so-called  precision  model  of 
Ref.  12  as  the  crossover  model.  However,  this  amount  of  detail  was 
considered  to  be  beyond  the  scope  of  the  present  effort. 

The  results  from  this  example  indicate  that  optimal  control  theory  and 
the  crossover  models  presented  in  Ref.  12  can  indeed  be  used  effectively 
to  develop  a  pilot  describing  function  appropriate  to  a  particular  controlled 
element . 

What  is  more,  in  the  course  of  performing  the  surveys  leading  to  the 
above  results  we  have  uncovered  a  particularly  useful  formulation  for  the 
problem  of  synthesizing  optimal  closed-loop  controllers.  This  formulation 
produces  controllers  which  implement  the  primary  rule  of  thumb  for  frequency 
response  synthesis.  Moreover,  these  controllers  tend  to  use  "practical" 
compensation  elements  such  as  approximate  integration  in  place  of  exact 
integration  and  lead/lag  filtering  in  place  of  exact  differentiation,  which 
are  important  considerations  when  the  controller  is  to  be  realized  using 
"real"  components. 
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4  YpYc  (deg) 


w  (rad /sec) 


bpY*L  <YpYcWe«) 
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SUMMAKf 

The  search  for  new  models  of  the  human  pilot  in  dynamic  control  roles 
has  been  approached  in  two  ways.  First,  the  status  and  deficiencies  of 
existing  quasi -linear  pilot,  models  have  been  used  to  specify  new  model 
requirements.  Second,  the  large  body  of  known  analytical  techniques  used 
in  the  automatic  control  field  has  been  reviewed  in  an  effort  to  uncover 
new  modeling  methods  which  may  be  useful.  In  some  cases,  the  merits  of 
the  new  model/methods  considered  have  been  assessed,  whereas  in  others 
only  the  technical  basis  for  an  assessment  has  been  established. 

Deficiencies  in  the  existing  quasi -linear  models  have  led  to  an 
investigation  of  the  following  topics: 

•  Low  frequency  lead  generation  using  either  velocity 
sensing  at  the  periphery  (eye)  or  difference  computa¬ 
tions  accomplished  at  a  more  central  level. 

•  Mode -switching  models  for  nonstationary  or  discrete 
inputs  to  the  pilot /vehicle  system. 

•  Physiological  aspects  of  pilot  dynamics  in  tracking 
tasks . 

•  Successive  Organization  of  Perception  (SOP)  theory 

for  levels  of  pilot  cognition  higher  than  compensatory. 

All  of  these  approaches  are  likely  to  prove  fruitful  in  the  future. 

Analytical  approaches  from  automatic  control  theory  which  appear  to 
have  the  most  promise  have  been  investigated  and  summarized.  These  include 


•  Time-optimal  computing  feedforward  elements  useful  in 
the  mode -switching  models  for  response  to  nonstationarv 
inputs . 

•  Optimal  control  theory  using  the  crossover  model  in  the 
performance  criterion  to  estimate  pilot  response  charac¬ 
teristics  in  compensatory  tasks. 

•  Inverse  optimal  control  theory  using  known  experimental 
results  and  quasi -linear  pilot  response  models  in  an 
effort  to  define  the  pilot'' s  adjustment  rules  in  terms 
of  performance  indices. 


•  Optimal  control  theory  to  provide  a  simple  test  for 
optimality  (to  an  elementary  quadratic  criterion) 
using  only  average  performance  measure  data. 

The  most  promising  of  the  analytical  approaches  a  posteriori  is  the  second 
listed,  which  permits  a  routine  computational  procedure  to  be  used  to 
estimate  pilot  response  characteristics  for  novel  situations. 
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FROG*  THAI  IQ.  11 ,  «a  =  a|-n2-2kc2  , 

Z9  A  SIGZMAR?  AKD  SUJTXCEMT  OOHDXTIOK  TOR  OPTIMALITY 
WITS  IO0P1OT  TO  THE  CRITBRIOH  MEf(«2  +ko2) 


Employing  a  procedure  similar  to  that  of  Chang  (Ref.  132),  it  can  be 
shown  that  the  optimum  system  transfer  function  is,  with  the  formulation 
of  Fig.  47, 


HJG  = 


J 


<j> 

£ _ 

j  (®rr)  (1  4  h/GG) 


(A- 1  ) 


where  the  controller  transfer  function  HJ  can  be  factored  into  a  product 
of  H,  containing  only  left  half  plane  poles  and  zeros,  and  J,  containing 
right  half  plane  zeros  ( 3  *  J  =  1  for  a  minimum-phase  controller) .  For 
the  human  operator,  J  is  the  nonminimum-phase  factor  of  the  Pade  approxi¬ 
mation  to  the  time  delay  term,  e  ''ane.  The  controlled  element  transfer 
function  G  is  stable  but  may  contain  right  half  plane  zeros.  <I>rr  is  the 
power  spectrum  of  the  total  input  r  =  i+  n^,  hence  <t>rr  =  4  ^in4  ^ni  4  ^nn 

^rm^  is  the  cro88  spectrum  between  the  input  and  desired  output.  If  the 
output  can  be  generated  by  a  linear  operation  with  transfer  function  F, 
acting  on  i,  then  =  (®ii4  ^ni^l  ♦  (  x  )+  denotes  the  product  of  all 

factors  of  x  with  LHP  poles  and  zeros,  (x  )  denotes  the  remaining  factor 
and  [  x  ]+  denotes  the  partial  fraction  expansion  of  x,  retaining  only  the 
partial  fractions  with  LHP  polti. . 

<t>€e  +  Mcc  ^ii  | -  Fn  ]  [HJG  -  F]  ]  +  kHH.JJ  | 

+  ti  n  j  [HJG  -  F-t  ]  HJG  +  kHHJJ  j 
+  4>nl  !  JhJG  -  F !  jHJG  +  kHHJjJ 
+  1>nnjHJnHJG  4  kHHJjj 


(A-2) 


Integrating  and  replacing  the  sum  of  the  middle  terms  by  twice  the  real 
part,  (R,  of  either,  and  using  4>rr  =  +  ^in  +  $ni  +  w 

€2  +  kc2  =  m2  +  n§  -  (P.^j  (SHJG^r  -  k^rHJHj)  djco  (A- 3) 

— Joo 

Substituting  from  Eq.  A-1 , 


HJG<D„ 


J  1 


J  («„)  (1  +  k/GG)  J  ,  J  (*rr)+(l  +  k/GG)  + 


(A-4) 


Splitting  up  (j/j)  [itiD^r/C^rr)  *  (l  +  k/GG)+]  into  partial  fractions,  only 
those  partial  fractions  with  RHP  poles  contribute  to  the  integral,  so 
Eq.  A- 3  becomes 


€2  +  kc2  =  m2  +  m^  +  kc2 


--fJC 

it  j«L 


Jo°  L J  (®rr)  (1  +  k/GG)  Jo.  L  («)rr)+  (l  +  k/GG)+J_ 


(A-sl 

The  <R  sign  has  become  redundant,  as  the  integrand  is  now  the  v  ^ 

product  of  complex  conjugates.  The  last  term  in  Eq.  A-5  can  be  written 


fJ”HjGHJG®rr(l  +k/GG)  dj®  =  -2m2  --  2kc2  (A- 6) 

'-It,!  w  — joo 


Substituting  Eq.  A-6  into  Eq.  k-'j  yields 

'*«'*  V  rW  /VV  rVW  /VW 

e2  +  kc2  =  m2  +  mjj  +  kc2  -  2m2  —  2kc2  (A-7) 

which  simplifies  to  the  desired  result,  Eq.  51, 

AAV  CAV  lA/\^ 

€2  =  -  m2  -  2kc2 
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